At Snapdragon Summit 2024, Qualcomm Technologies unveiled a partnership with Mistral AI to incorporate Mistral AI's generative models, Ministral 3B and Ministral 8B, into devices powered by Qualcomm's Snapdragon computing platforms. This integration includes the Snapdragon 8 Elite mobile platform, Snapdragon Cockpit Elite and Snapdragon Ride Elite for automotive applications, as well as the Snapdragon X series computing platform designed for AI PCs.
Mistral AI has introduced Ministral 3B and 8B, their first commercial AI models specifically engineered for device integration. These compact yet powerful models promise to deliver unparalleled experiences across smartphones, computers, and automotive devices.
Deploying AI on devices offers numerous benefits, including enhanced privacy, reduced latency, cost savings, increased reliability, and improved energy efficiency. Ministral 3B and 8B excel in common-sense reasoning, knowledge management, and task orchestration, with parameters kept below 10 billion. They are well-suited for various applications, such as agent-based workflows and specialized task automation.
Both models support a context length of up to 128k tokens. Additionally, the Ministral 8B model features a sliding window attention mechanism, enabling faster and more efficient memory utilization during inference.
Mistral AI highlights that as the demand for on-device, privacy-centric AI models continues to rise, these models are capable of handling tasks such as local translations, offline intelligent assistants, on-device analytics, and autonomous robotics. The Ministral models meet this market need by delivering efficient, low-latency solutions that excel in multiple tasks, frequently outperforming competitors.
When used in conjunction with larger language models like Mistral Large, Ministral 3B and 8B demonstrate robust capabilities. They are optimized for function calls within complex workflows, managing tasks such as input parsing, task routing, and executing API calls based on user intent. This results in minimal response times and reduced operational costs, making them highly suitable for real-world applications.
Qualcomm and Mistral AI are actively collaborating through the Qualcomm AI Center to rapidly provide developers with the Ministral 3B and 8B models. Currently, developers can access additional Mistral AI models, such as Mistral 7B v0.3, via the platform, thereby enhancing their AI solutions on devices.
Durga Malladi, Senior Vice President and General Manager of Technology, Planning, and Edge Solutions at Qualcomm Technologies, stated at the event, "We are excited to announce our collaboration with Mistral AI, aligning with our goal to provide cutting-edge AI technology for edge devices. Mistral AI's Ministral 3B and Ministral 8B will enable device manufacturers, software providers, and service providers to create innovative experiences, such as AI assistants that genuinely understand user needs and other applications, while delivering immediacy, reliability, and enhanced privacy protection."
Arthur Mensch, Co-founder and CEO of Mistral AI, shared his perspective on the collaboration, stating, "Partnering with Qualcomm Technologies is a significant milestone for Mistral AI, demonstrating how our new models can run directly on devices powered by Snapdragon platforms. This greatly enhances local processing speeds and contributes to reduced costs and energy consumption. Together, we are striving to make advanced AI more accessible, allowing developers and users worldwide to experience the full potential of our models directly on their devices."
