Musk: xAI to Launch Grok-2 Large Language Model in August

2024-07-02

In the wake of the successful launch of Grok AI 1.5 chatbot, tech giant Elon Musk officially announced the release schedule for the more advanced Grok 2 on Monday. This new version of Grok from xAI will integrate a range of cutting-edge AI features, building upon its predecessor's significant advancements in long-text comprehension and advanced logical reasoning, as well as its substantial performance improvements in benchmark tests such as MATH and HumanEval.

Musk not only outlined the blueprint for Grok 2 but also revealed the vision for Grok 3. When discussing the need for large language model datasets to optimize AI chatbot training, the billionaire entrepreneur pointed out that Grok 2 from xAI is set to make a splash in August this year, while Grok 3 is expected to meet the public before the end of the year.

Musk emphasized the importance of extensive dataset support for training AI chatbots and highlighted the time-consuming and labor-intensive task of cleaning the data to remove unsuitable content. He specifically mentioned some challenges encountered during training on the OpenAI model and teased that the upcoming Grok 2 will achieve a qualitative leap in dataset quality. "It's indeed a difficult problem, but the work of cleaning internet training data to optimize LLM (large language models) is making significant progress. Grok 2, which will be released in August, will take an important step in this regard," Musk said.

As for Grok 3, Musk revealed that it will undergo training with the powerful computing power of 100,000 Nvidia H100 GPUs. When it is unveiled at the end of the year, it is expected to not only surpass existing AI benchmark test scores but also inspire limitless imagination among AI enthusiasts worldwide.

The design concept of Grok 2 draws inspiration from the Guide to Intelligent Life in the Galaxy in "The Hitchhiker's Guide to the Galaxy" and the JARVIS intelligent system in "Iron Man." Its aim is to answer almost any question posed by users by constantly staying up-to-date with global knowledge. In addition, xAI delves deeper into the potential of AI and adds image generation capabilities to Grok 2, with plans to further enrich its intelligent response capabilities using web search results.

It is worth mentioning that as the Grok series products continue to evolve, industry giants have expressed their support. Dell Technologies CEO Michael Dell recently revealed that the company is collaborating with Nvidia to build an AI factory and explicitly stated that they will help elevate xAI's Grok generative AI technology to new heights.