According to financial news outlets, Elon Musk's xAI company is raising several billion dollars in funding, which will significantly enhance its valuation. Reports indicate that the total investment could reach up to $6 billion, expected to be completed early next week. The majority of the funds ($5 billion) will be provided by Middle Eastern sovereign wealth funds, with the remaining amount sourced from other investors. Following this financing round, xAI's valuation is projected to reach $50 billion.
Another financial daily reported that the AI development company has raised $5 billion. According to its sources, xAI's current valuation stands at $45 billion, slightly lower than the previous media report but still $21 billion higher than its valuation after the last funding round in May this year.
Founded last year, xAI aims to compete with OpenAI in the large language model sector. In November last year, the company launched its first large language model, Grok, and has open-sourced it. Since then, xAI has introduced several new proprietary models with more advanced features.
To support its AI development efforts, xAI has built a supercomputer named Colossus in Memphis, equipped with 100,000 Nvidia H100 GPUs. The system was officially launched in September last year. Reports suggest that xAI may utilize the latest funding round to deploy an additional 100,000 GPUs at the Memphis data center.
The upgrade of the supercomputer comes as no surprise. Last month, Musk announced plans to soon expand Colossus by 100,000 chips. It is expected that half of these will be the more advanced H200 GPUs, featuring an 80% increase in memory and a 40% boost in memory bandwidth over the previous generation. Since AI models transfer data between memory more frequently than other workloads, the enhanced bandwidth can significantly improve the performance of large language models.
With the newly raised funds, xAI may purchase additional equipment from Nvidia. In addition to the H100 GPUs, Colossus is also equipped with Nvidia's SN5600 Ethernet switches and utilizes Nvidia's BlueField-3 processors to perform certain infrastructure management tasks.
Financial news outlets report that the upgraded supercomputer will support Tesla's Full Self-Driving software. This software comprises a suite of partial autonomous driving features, which Tesla has equipped in some of its vehicles. Cars with Full Self-Driving capabilities can automatically change lanes, park, stop at red lights, and perform related tasks.
The upgraded supercomputer is also expected to support xAI's own AI development initiatives. Earlier this month, the company launched its latest large language model, grok-beta, capable of handling prompts with up to 128,000 tokens and interacting with other applications. The additional computing power provided by the planned Colossus expansion should enable xAI to build more advanced large language models.
Meanwhile, OpenAI is reportedly also working to expand its AI development infrastructure. According to a tech news report, the developers of ChatGPT and Microsoft are currently in the third phase of a five-phase supercomputer construction project. The project is expected to culminate in a system with millions of AI processors by 2028.
