Meta to Release Large-Scale Open-Source AI Model Llama 3-405B

2024-07-15

According to a report from "The Information" on Friday, Meta is preparing to launch its latest open-source AI model, Llama 3-405B, on July 23. This model is an extension of the existing Llama 3 series and introduces a version with a staggering 4.05 trillion parameters, making it one of the largest open-source language models to date. In April of this year, Meta's CEO Mark Zuckerberg mentioned that the company was working on training a model with an exceptionally large number of parameters, but did not provide specific details about its scale. Now, with the leak of internal information, this model with 4.05 trillion parameters has finally come to light, further enriching Meta's AI portfolio. Llama 3-405B is designed as a multimodal AI model capable of processing various media content, including images and text, demonstrating powerful cross-domain understanding capabilities. This feature gives the model potential in multiple application scenarios, including but not limited to natural language processing, image recognition, and cross-media analysis. It is worth noting that although the model has not been officially released, developers have already shared their experiences using it on social media platforms, further validating its feasibility and appeal in practical applications. As the July 23 release date approaches, anticipation and attention from the industry towards Llama 3-405B continue to grow.