Elon, stop trying to make Grok happen | The Verge

Overview

Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech

Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews

Details

Science Expand Space Energy Environment Health See all science

Entertainment Expand TV Shows Movies Audio See all entertainment

Policy Expand Antitrust Politics Law Security See all policy

Gadgets Expand Laptops Phones TVs Headphones Speakers Wearables See all gadgets

Verge Shopping Expand Buying Guides Deals Gift Guides See all shopping

Streaming Expand Disney HBONetflix You Tube Creators See all streaming

Transportation Expand Electric Cars Autonomous Cars Ride-sharing Scooters See all transportation

AIClose AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All AI

Posts from this topic will be added to your daily email digest and your homepage feed.

Report Close Report Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Report

Posts from this topic will be added to your daily email digest and your homepage feed.

x AIClosex AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All x AI

Posts from this topic will be added to your daily email digest and your homepage feed.

New data suggests government workers don’t like Elon Musk’s chatbot. Does anybody?

Posts from this author will be added to your daily email digest and your homepage feed.

There is a harsh truth about Elon Musk’s “truth-seeking” AI chatbot Grok: It’s not very good, and not many people are using it. That’s the takeaway of a new Reuters report, which found that Grok barely appears in federal records of how the US government used AI last year. It’s not the only sign x AI’s signature chatbot is in trouble, even as Musk puts it at the heart of what could be the biggest IPO in history.

Reuters reviewed more than 400 examples of government AI use where specific vendors were named. Grok or x AI, it found, appeared in only three — each of those for basic uses like document drafting or social media management, and always alongside competitors like Microsoft and Open AI. Open AI’s models, by comparison, appeared in more than 230 examples, while Google and Anthropic each appeared dozens of times.

A similar pattern appeared in another database of more ambitious government AI projects with smaller numbers of users. Grok appeared just three times: twice for routine administrative tasks at the Election Assistance Commission, and once in a Department of Energy pilot at Lawrence Livermore National Laboratory for document summaries and general research. Reuters found 140 entries involving Microsoft and Open AI, while my brief review found at least 10 entries for Anthropic and dozens for Google’s Gemini.

The lists are an incomplete and patchy measure of government adoption. Many more examples are listed without a specific vendor, and it’s clear there is no universal definition of what counts as AI. The data also doesn’t capture intelligence agencies or the Pentagon — where x AI secured a $200 million contract last year and was recently cleared to operate on classified networks after Anthropic’s blacklisting.

Still, it’s not looking good for Grok. It shows up far less than its rivals, and when it does show up, it’s mostly for basic admin work — hardly befitting the world-class frontier model Musk has spent years bragging about.

People who spoke to Reuters suggested the explanation was simple: Grok isn’t as good as its rivals. It’s “just not the best model out there,” an unnamed Pentagon source said, adding that staffers there tend to prefer Gemini or Claude. Public leaderboards ranking AI models lend weight to that view. Anthropic, Google, and Open AI dominate the top ranks, while Grok rarely cracks the top 10 outside the occasional image or video category.

That’s awkward for Musk, and even more awkward for Space X, which absorbed x AI earlier this year. The rocket venture’s IPO filing shows the company has put AI — and Grok specifically — at the heart of its pitch to investors. Space X claims to have identified “the largest actionable total addressable market in human history”: an astonishing $28.5 trillion opportunity, though, sadly, it offers no timetable for getting there. Practically all of this estimated value comes from AI, enterprise AI in particular, not rockets or satellites.

Reuters notes that Grok’s performance in government agencies could hint at how well it does in other workplaces, too. As part of x AI’s push for enterprise customers, Musk has reportedly strong-armed banks into buying Grok subscriptions if they wish to participate in Space X’s IPO — but if they’re not getting their money’s worth, these deals could prove a short-term fix.

Elon Musk confirms x AI used Open AI’s models to train Grok

Space X just filed for what could be the biggest IPO ever

As if its dreary performance wasn’t awkward enough, Musk recently admitted that x AI has used Open AI’s models to help train and improve Grok. The process, known as distillation, is standard when companies are using their own models, but far more contentious when it involves using a rival’s system. Grok can’t even beat the models it’s training on.

In its public-facing consumer version, Grok is deliberately unpleasant. Musk has branded the chatbot a less biased and less censored alternative to tools like Chat GPT, but that’s translated into a product with loose evidentiary standards, an unhealthy obsession with Musk, and a long track record of offensive, conspiratorial, and sexualized outputs. Even if workplace guardrails are different, it may not be the kind of thing a business would welcome. Grok’s illustrious record includes praising Adolf Hitler, casting doubt on Holocaust death tolls, plastering millions of nonconsensual sexualized deepfakes all over X, including ones of children, and powering a racist and transphobic Wikipedia knockoff and spicy anime girlfriend. And let us not forget the time it called itself “Mecha Hitler.” If Grok were a human employee, I feel HR would not take long to get involved.

Space X appears to understand the problem. In its filing, the company warned Grok’s “spicy” or “unhinged” modes carry “heightened risks,” including reputational damage, regulatory scrutiny, and lawsuits. In corporate speak: This chatbot is going to get us sued.

In corporate speak: This chatbot is going to get us sued.

Grok takes its name from Robert A. Heinlein’s Stranger in a Strange Land, where it roughly means a deep and profound understanding of something. The thing to understand here is not particularly complex: Musk has spent billions building a chatbot that is not very good, not very popular, and somehow key to justifying Space X’s astronomical valuation. Good luck with that.

Robert Hart Close Robert Hart AI Reporter Posts from this author will be added to your daily email digest and your homepage feed. Follow Follow See All by Robert Hart

Posts from this author will be added to your daily email digest and your homepage feed.

AIClose AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All AI

Posts from this topic will be added to your daily email digest and your homepage feed.

Report Close Report Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Report

Posts from this topic will be added to your daily email digest and your homepage feed.

x AIClosex AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All x AI

Posts from this topic will be added to your daily email digest and your homepage feed.

‘Fuck you, Bambu’: How one private message could change the face of 3D printing

Anker’s new earbuds have the best call quality I’ve ever heard

The new Flipper One is a pocket-sized Linux computer

Key Takeaways

Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
Science Expand Space Energy Environment Health See all science
Entertainment Expand TV Shows Movies Audio See all entertainment
Policy Expand Antitrust Politics Law Security See all policy