US troops nearly boarded a Chinese ship after a chatbot invented a fake nuclear weapons cargo story | Tech Radar
Overview
News, deals, reviews, guides and more on the newest computing gadgets
Start exploring exclusive deals, expert advice and more
Details
Unlock and manage exclusive Techradar member rewards.
Unlock instant access to exclusive member features.
Get full access to premium articles, exclusive features and a growing list of member rewards.
'It almost started a war': US Army nearly boarded a Chinese ship after receiving an "entirely false" AI-hallucinated intelligence report saying it had nuclear arms on board
AI hallucination almost dragged the US into war with China over a cargo ship
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.
A chatbot invented entirely false cargo details about a Chinese vessel
Armed troops prepared to board the ship before anyone checked the source
Military aircraft were already active when officials caught the error
A false intelligence assessment nearly triggered a US military invasion of a Chinese vessel after AI-assisted analysis wrongly identified its cargo.
The report circulated during the Iran conflict and prompted preparations to intercept the vessel before officials discovered serious problems with its underlying information.
Sources told CNN that armed personnel were preparing to board while military aircraft supported preparations, creating a potentially dangerous confrontation between major powers.
AI-assisted analysis produced the mistaken assessment
The episode began when an analyst examined intelligence concerning the ship's manifest and used a chatbot to interpret information.
Sources said the system combined publicly available material with classified signals information before producing an incorrect assessment about the vessel's cargo.
Bomb Chinese data centers to prevent development of AGI, says Former Obama Admin Official — nothing says ‘competition breeds innovation’ like blowing up your rivals
World-first autonomous ‘end-to-end’ AI attack against Taiwan tied to Chinese hackers
In a twist of irony, a Chinese open source GLM 5.2 AI model contained 'rogue' Open AI GPT-5.6 Sol in a Hugging Face hack just as the US mulls banning open-weight AI
The analyst subsequently used AI again to prepare the findings in a standard intelligence format that was distributed among military officials.
Officials only examined the underlying information shortly before the planned operation, revealing that the reported cargo identification was wrong.
The source described the assessment as “entirely false,” while CNN reported that another source said it “almost started a war.”
The exact material that the chatbot misidentified has not been disclosed publicly, leaving important details about the original error unavailable.
The Pentagon and the military command responsible for Pacific special operations did not provide comments on the incident.
Chinese military reportedly uses American AI models to train its defense systems
Top AI tools such as Open Claw and Github Copilot can be hijacked to create new massive botnets
US Army forced to reinstate limits on AI token usage after troops blew through allowances
The episode comes as the US military expands its use of AI tools across intelligence, operations, administration, and battlefield decision-making.
In January, Defense Secretary Pete Hegseth announced an AI strategy intended to accelerate deployment across military missions and organizational functions.
“We will unleash experimentation, eliminate bureaucratic barriers, focus our investments and demonstrate the execution approach needed to ensure we lead in military AI,” Hegseth said.
The strategy includes programs for intelligence work, operational planning, enterprise functions, and wider access to generative AI systems.
The department later said more than 1.3 million personnel had used Gen AI.mil, generating tens of millions of prompts within five months.
The incident exposes a difficult verification problem
The reported mistake involved more than an inaccurate chatbot response because its output entered a process used for consequential military decisions.
Once incorrect information appeared in a formal assessment, officials receiving the document had to determine whether its underlying evidence supported the conclusion.
There is no information on which verification procedures were applied before the assessment reached personnel preparing the maritime operation.
It also remains unclear whether the analyst knew that the chatbot had introduced an incorrect interpretation before the report circulated.
According to CNN, different military organizations use different AI systems, while officials have described varying practices for checking information produced by them.
That fragmented environment makes it difficult to identify a single verification process governing every AI-assisted intelligence product across the military.
AI tools can make military analysis faster and easier, yet their potential for significant errors requires strict human verification before operational decisions.
That need becomes more important when intelligence concerns a rival country, where an incorrect assessment involving a military vessel could trigger retaliation.
A mistaken attack could then escalate tensions between the countries involved, potentially producing a wider armed confrontation or prolonged political and military conflict.
Follow Tech Radar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.
Efosa has been writing about technology for over 7 years, initially driven by curiosity but now fueled by a strong passion for the field. He holds both a Master's and a Ph D in sciences, which provided him with a solid foundation in analytical thinking.
You must confirm your public display name before commenting
As RAM prices soar, this fast 32GB Team Group DDR5-6400 kit is $50 off
Save $40 on Cyber Link Director Suite for video, photo and audio editing
'It's like a ground drone': I tested a cute little robot called Beni that follows and films you
Most Americans now oppose data centers in some way as tide continues to turn on AI technology
Netflix faces backlash for using AI-generated Gene Wilder voice in Wonka reality show
Tech Radar is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.
© Future US, Inc. Full 7th Floor, 130 West 42nd Street, New York, NY 10036.
Key Takeaways
- News, deals, reviews, guides and more on the newest computing gadgets
- Start exploring exclusive deals, expert advice and more
- Unlock and manage exclusive Techradar member rewards
- Unlock instant access to exclusive member features
- Get full access to premium articles, exclusive features and a growing list of member rewards
