Scientists say AI is falling for 'alien hoaxes' too easily — and that's a problem for research | Tech Radar
Overview
News, deals, reviews, guides and more on the newest computing gadgets
Start exploring exclusive deals, expert advice and more
Details
Unlock and manage exclusive Techradar member rewards.
Unlock instant access to exclusive member features.
Get full access to premium articles, exclusive features and a growing list of member rewards.
Scientists say AI is falling for 'alien hoaxes' too easily — and that's a problem for research
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.
Can we trust AI's pattern-spotting capabilities? (Image credit: Getty Images)
Researchers have spotted problems with AI pattern matching in science data
It could mean false flags for signatures of life on other planets
AI can still be useful, but checks need to be built in
One of the ways AI can be most helpful is in trawling through masses of scientific data that human researchers don't have time to analyze, looking for patterns — but this use-case is now proving problematic when it comes to the search for life beyond our planet.
A new study from researchers at Michigan State University suggests that AI systems can be too easily fooled into identifying signatures of life out in the universe where none exist. We need these flags to be accurate to know where to point our telescopes next, so it's important that the detection processes work.
The researchers set up a digital simulation including a key sign of life: the ability for molecules to replicate and mutate. Software was used to generate tens of thousands of digital organisms with and without this ability, which where then used to trail a neural network to spot the difference with an accuracy rating of 99.7%.
When the neural network was pointed towards data it hadn't previously seen, however, the AI's life-spotting skills fell apart. The researchers started with a digital organism that couldn't copy itself, which the AI correctly identified, then began making small edits and asking the AI to check again.
Essentially, as the AI was nudged out of its comfort zone of training data, it started seeing life where there wasn't any. "No matter what sequence of commands we started with, we were able to fool the AI 100% of the time," said Ankit Gupta, one of the researchers.
'AI tools could lead to nothing less than the death of astrophysics': Researchers predict bleak future for thousands who study black holes, galaxies, and supernovae
Microsoft CSO acknowledges that humans are struggling to keep up with AI
Gemini leads in human-like AI writing as detection tools fall behind
A representation of the simulation the AI was tested on (Image credit: University of Michigan)
It's worth bearing in mind the limitations of this research: these tests were carried out in an artificial, digital simulation, and so didn't rely on any real data. The researchers were deliberately searching for errors too, rather than letting them happen by chance.
However, the study methods are solid enough to be concerning. The worry is that a Mars rover or a deep-space telescope could identify a life signature with a high degree of confidence, without necessarily having a human in the loop to check.
The researchers found there were a vast number of sequences that could trip up the AI too, meaning the risk of a mistake is more likely. While the digital organisms incorrectly identified by the neural network were close to what it had been trained to spot, they weren't full matches — despite the AI thinking they were.
These issues could crop up outside of space exploration too. The same errors might appear when looking for patterns in medical scans, security camera footage, and everywhere else the technology is used.
That said, the researchers are keen to emphasize that AI can still be useful in these scenarios — it just needs careful checks and supervision. "AI has an Achilles' heel: it can see a pattern and completely misclassify it," said Christoph Adami, one of the team. "There needs to be a human in the loop."
Follow Tech Radar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.
➡️ Read our full guide to the best laptops
- Best overall: Apple Mac Book Air 13-inch M5
- Best budget: Apple Mac Book Neo
- Best Windows 11 laptop Microsoft Surface Laptop 13-inch
- Best thin and light: Lenovo Yoga Slim 9i
- Best Ultrabook Asus Zenbook S 16
Dave is a freelance tech journalist who has been writing about gadgets, apps and the web for more than two decades. Based out of Stockport, England, on Tech Radar you'll find him covering news, features and reviews, particularly for phones, tablets and wearables. Working to ensure our breaking news coverage is the best in the business over weekends, David also has bylines at Gizmodo, T3, Pop Sci and a few other places besides, as well as being many years editing the likes of PC Explorer and The Hardware Handbook.
You must confirm your public display name before commenting
1 Open AI’s next Chat GPT-5.6 upgrade may be too powerful to launch like a normal app update
2 Scientists say AI is seeing signs of alien life where there aren't any — and that's a problem for research
3‘The impact to thousands of companies across industries will be huge’: Google Earth Pro for desktop is being discontinued, and some users are furious
4“It's never been a more exciting time to imagine what's possible with software’: Xero CEO outlines how AI could transform the finance industry as we know it
5 That free, two hour long Silent Hill game is getting a physical for some reason — and of course it costs $70
Tech Radar is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.
© Future US, Inc. Full 7th Floor, 130 West 42nd Street, New York, NY 10036.
Key Takeaways
- News, deals, reviews, guides and more on the newest computing gadgets
- Start exploring exclusive deals, expert advice and more
- Unlock and manage exclusive Techradar member rewards
- Unlock instant access to exclusive member features
- Get full access to premium articles, exclusive features and a growing list of member rewards
