"MiLM, Xiaomi's large language model, is expected to be applied in the fields of automobiles, smartphones, and smart homes after filing for record."

2024-05-16

Today, Xiaomi officially announced an important update on its official Weibo account. Its self-developed large language model, MiLM, has officially passed the large model filing, indicating that the model is about to enter a new phase of application. According to Xiaomi, the MiLM model will gradually be integrated into various products such as Xiaomi cars, smartphones, and smart homes, providing users with smarter and more convenient experiences, and will be open to more users.

MiLM, since its first appearance on the C-Eval and CMMLU large model evaluation list in August last year, has attracted widespread attention in the industry due to its outstanding performance. In the overall C-Eval list, MiLM ranks 10th with its excellent performance and ranks first in the same parameter level.

It is worth mentioning that according to the GitHub project page, MiLM-6B, as a large-scale pre-training language model developed by Xiaomi, has a parameter scale of up to 6.4 billion. This huge parameter scale provides strong support for handling complex language tasks.

In the specific evaluation of C-Eval, the MiLM-6B model achieved high accuracy in 20 subjects in the STEM (Science, Technology, Engineering, and Mathematics) field, especially in projects such as metrology, physics, chemistry, and biology. In addition, the model also demonstrated relatively good accuracy in most humanities subjects.

However, there is still room for improvement in subjects involving "abstract thinking" such as law, mathematics, programming, probability theory, and discrete mathematics. Xiaomi stated that it will continue to optimize the model algorithm to improve its performance in these areas.

In the fields of social sciences and humanities, MiLM-6B also demonstrates impressive capabilities. In 10 "social science" test subjects, except for "education and geography," the model achieved ideal accuracy in the other 8 subjects. In the 11 subjects of humanities, MiLM-6B performed well in "history and law."

With the gradual application of the MiLM large model, Xiaomi users will be able to enjoy more intelligent and personalized services. From Xiaomi cars to smart homes, from smartphones to various smart devices, the addition of MiLM will inject new vitality into the Xiaomi ecosystem. Xiaomi stated that it will continue to increase investment in the field of artificial intelligence to bring users more innovative products and experiences.