"Sakana AI Introduces Novel Method for Evolutionary Model Integration"

2024-03-22

Sakana AI, a startup led by former Google research elites David Ha and Llion Jones, has recently launched a new AI model inspired by the unique combination of evolution and collective intelligence. The Sakana AI team has ingeniously developed a technique called "Evolutionary Model Merge" that efficiently integrates various open-source models to create new models with user-specified functionalities. This method has the ability to automatically discover new approaches to model fusion in different domains, such as non-English languages and mathematics, or vision and language, surpassing the capabilities of human experts. Each generation of outstanding models is selected as "parents" for subsequent generations, driving the continuous evolution of the models. Sakana AI announced that they have successfully applied this technique to evolve large-scale language models (LLM) and vision-language models (VLM) capable of mathematical reasoning, achieving excellent results in multiple benchmark tests. This Tokyo-based startup has already released three Japanese language models, with two of them, EvoLLM-JP and EvoVLM-JP, having their source code open to the public. Users can easily access them on platforms such as Hugging Face and GitHub. Sakana AI is confident about the future and expects the rise of evolutionary AI to lead to a revolution in model combination, uncovering more models with astonishing capabilities. So far, Sakana AI has successfully raised $30 million in seed funding, demonstrating high recognition from investors for its potential and prospects. Sakana AI's vision is to make Tokyo a significant hub for AI innovation, standing alongside globally renowned AI research institutions like OpenAI in San Francisco and DeepMind in London.