Elon Musk, the CEO of xAI, revealed last summer that Grok 3, their next AI model, would go on the market by the end of 2024. Grok faces challenges from models such as Google's Gemini and OpenAI's GPT-4. It can react to enquiries and examine images.
Grok 3 has not yet been launched as of January 2, and Grok 2.5, a smaller variant, may be the first. There have also been delays for other businesses, including Anthropic. This recommends that current strategies for AI development may be reaching their limits.
xAI Next Model Has not yet Launched
The CEO and founder of xAI, billionaire Elon Musk, claimed last summer that Grok 3, the company's next large AI model, would be launched by the "end of year" 2024. Grok, xAI's response to models like Google's Gemini and OpenAI's GPT-4o, can examine photographs and give answers. It also drives several aspects of Musk's social network, X.
"Grok 3 should be something special at the end of the year after practising on 100k H100s," Musk posted in a July on X, pointing to xAI's massive GPU array built in Memphis. In a follow-up post shared in mid-December, he claimed, "Grok 3 will be a significant move forward."
However, as of January 2, Grok 3 has not yet been introduced, and there are no signals that it will be soon. AI tipster Tibor Blaho observed some code on xAI's website that shows an intermediate model called "Grok 2.5" might arrive first.
Furthermore, Musk said that Grok 3 would "hopefully" be launched in 2024 "if we're lucky" in an August interview with podcaster Lex Fridman. However, Grok 3's MIA status is captivating since it fits into an increasing pattern.
Anthropic, an AI startup, had no chance to offer a replacement for its flagship Claude 3 Opus model last year. Anthropic eliminated all references to the Claude 3.5 Opus model from their developer documentation a few months after claiming that a next-generation model would be published by the end of 2024.
The techniques businesses employ to grow their models' capabilities may be a sign of the limitations of the current AI scaling laws. In the not-too-distant past, training models with ever-raising data sets and huge processing power enabled significant performance gains. However, the benefits have declined with each model generation, which has caused businesses to look for different approaches.
Elon Musk Statement in Fridman Interview
In the Fridman interview, Musk himself referred to this.
Fridman asked Elon: "You want Grok 3 to be the most sophisticated?"
“Hopefully,” Musk answered:
“This is the goal, after all. We might not achieve this goal. That is the aspired outcome.”
Other factors might have led to the delay in Grok 3. For starters, xAI's crew is substantially smaller than many competitors. However, the shortened launch time frame further helps the idea that traditional AI training methods are facing a challenge.