Elon Musk confirms x AI used Open AI’s models to train Grok | The Verge
Overview
Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
Details
Science Expand Space Energy Environment Health See all science
Entertainment Expand TV Shows Movies Audio See all entertainment
Policy Expand Antitrust Politics Law Security See all policy
Gadgets Expand Laptops Phones TVs Headphones Speakers Wearables See all gadgets
Verge Shopping Expand Buying Guides Deals Gift Guides See all shopping
Streaming Expand Disney HBONetflix You Tube Creators See all streaming
Transportation Expand Electric Cars Autonomous Cars Ride-sharing Scooters See all transportation
AIClose AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All AI
Posts from this topic will be added to your daily email digest and your homepage feed.
News Close News Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All News
Posts from this topic will be added to your daily email digest and your homepage feed.
Policy Close Policy Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Policy
Posts from this topic will be added to your daily email digest and your homepage feed.
Elon Musk confirms x AI used Open AI’s models to train Grok
He said it was “partly” true that the company had used model distillation to improve x AI’s models.
He said it was “partly” true that the company had used model distillation to improve x AI’s models.
Posts from this author will be added to your daily email digest and your homepage feed.
If you buy something from a Verge link, Vox Media may earn a commission. See our ethics statement.
Posts from this author will be added to your daily email digest and your homepage feed.
In a federal courtroom in California on Thursday, Elon Musk testified that his own AI startup, x AI, has used Open AI’s models to improve its own.
The matter at question is model distillation, a common industry practice by which one larger AI model acts as a “teacher” of sorts to pass on knowledge to a smaller AI model, the “student.” Although it’s often used legitimately within companies using one of their own AI models to train another, it’s also a practice that’s sometimes used by smaller AI labs to try to get their models to mimic the performance of a larger competitor’s model.
Asked on the stand whether he knew what model distillation was, Musk said it’s to use one AI model to train another. When asked whether x AI has distilled Open AI’s technology, Musk seemed to avoid the question, saying that “generally all the AI companies” do such a thing. And when asked if that was a yes, he said, “Partly.”
When pressed, Musk said, “It is standard practice to use other AIs to validate your AI.”
In Anthropic’s own blog post on the matter, the company wrote, “Distillation is a widely used and legitimate training method. For example, frontier AI labs routinely distill their own models to create smaller, cheaper versions for their customers. But distillation can also be used for illicit purposes: competitors can use it to acquire powerful capabilities from other labs in a fraction of the time, and at a fraction of the cost, that it would take to develop them independently.”
Hayden Field Close Hayden Field Senior AI Reporter Posts from this author will be added to your daily email digest and your homepage feed. Follow Follow See All by Hayden Field
Posts from this author will be added to your daily email digest and your homepage feed.
AIClose AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All AI
Posts from this topic will be added to your daily email digest and your homepage feed.
Anthropic Close Anthropic Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Anthropic
Posts from this topic will be added to your daily email digest and your homepage feed.
Elon Musk Close Elon Musk Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Elon Musk
Posts from this topic will be added to your daily email digest and your homepage feed.
Law Close Law Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Law
Posts from this topic will be added to your daily email digest and your homepage feed.
News Close News Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All News
Posts from this topic will be added to your daily email digest and your homepage feed.
Open AIClose Open AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Open AI
Posts from this topic will be added to your daily email digest and your homepage feed.
Policy Close Policy Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Policy
Posts from this topic will be added to your daily email digest and your homepage feed.
Tech Close Tech Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Tech
Posts from this topic will be added to your daily email digest and your homepage feed.
x AIClosex AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All x AI
Posts from this topic will be added to your daily email digest and your homepage feed.
More in: Live updates from Elon Musk and Sam Altman’s court battle over the future of Open AI
The more young people use AI, the more they hate it
Motorola just revealed the Razr Fold’s price and hoo boy
Key Takeaways
- Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
- Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
- Science Expand Space Energy Environment Health See all science
- Entertainment Expand TV Shows Movies Audio See all entertainment
- Policy Expand Antitrust Politics Law Security See all policy
