Researchers say Google AI Mode changes recommendations based on your emails — and it risks creating a giant confirmation-bias machine | Tech Radar

Overview

News, deals, reviews, guides and more on the newest computing gadgets

Start exploring exclusive deals, expert advice and more

Details

Unlock and manage exclusive Techradar member rewards.

Unlock instant access to exclusive member features.

Get full access to premium articles, exclusive features and a growing list of member rewards.

Researchers say Google AI Mode changes recommendations based on your emails — and it risks creating a giant confirmation-bias machine

Google’s AI search may be secretly shaping answers using your private data

When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.

Researchers found brands linked to Gmail activity appeared far more often in Google AI Mode results

The effect was strongest for shopping searches like clothing, coffee machines and running shoes

AI-powered search could reinforce existing habits instead of helping users discover new things

We all know that AI is often so eager to help that it can feel like it's simply reflecting whatever you think back at you in a way that feels sycophantic and artificial. We’ve written quite a few articles about how to stop chatbots like Claude, Chat GPT and Gemini from doing this, usually using some variation of the “be brutally honest” or “invert” prompt.

Now it turns out that AI’s tendency to keep you inside an echo chamber may extend beyond chatting with a bot. Researchers claim that if you’ve got Google’s Personal Intelligence switched on, AI Mode could start feeding more brands from your Gmail activity back into your search results.

Researchers at i Pull Rank tested nearly 2,000 Google AI Mode responses and found that brands connected to a user’s Personal Intelligence data appeared dramatically more often in results. In accounts linked to services like Gmail, certain brands showed up in AI answers almost three times as frequently and were far more likely to appear in the top recommendations.

Why Google’s new AI search wants to do your thinking for you

'This new search box does not mean that you'll only get AI responses': Google's Search makeover incorporates yet more AI, but Google promises to leave room for classic results

"Google Search is now AI Search" equals the worst thing to happen to the internet since social media, except this time we can all see it coming

Gmail appeared to have the biggest influence. Brands connected through email activity were cited far more often than brands linked through other Google services like Photos. The effect was especially noticeable for everyday shopping categories such as hoodies, coffee machines and running shoes, suggesting Google’s AI recommendations may become easier to shape based on a user’s personal data and habits.

As we reported recently, Google Search is increasingly turning into AI search, whether you like it or not, but if the new research from i Pull Rank is accurate then Google’s new AI-powered search risks becoming a giant confirmation-bias machine, feeding users more of the brands and products they already know instead of helping them discover new ones.

Personally, I can see the benefits of Google wanting to become an answer engine rather than just a search engine. A lot of the time when I’m using search, I’m simply looking for a fast answer to a question, so this change can genuinely save me time. But the danger of personalization replacing exploration is that we lose some of the magic of Google Search leading us toward unexpected websites, products or ideas that turn out to be genuinely useful.

Before we raid Google towers carrying pitchforks and torches, it’s worth remembering that Personal Intelligence is an opt-in feature designed to make AI feel more useful and personalized to you. If you’re worried about it reducing the chance of serendipity in your search results, you can turn it off.

Personal Intelligence is off by default, but if you’ve enabled it and now want to disable it, open Gemini’s Settings (the gear icon at the bottom left), select Personal Intelligence, then click Connected Apps and toggle the services you want Gemini to access, such as Gmail.

It’s also important to note that this testing was carried out by external researchers, rather than Google publicly confirming exactly how AI Mode rankings and recommendations are generated.

Still, the findings raise an interesting question about the future of AI-powered search. If search engines become increasingly personalized around our habits, purchases, conversations and preferences, are they actually helping us explore the web, or just building increasingly convincing digital mirrors that reflect our existing tastes right back at us?

Follow Tech Radar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.

➡️ Read our full guide to the best Mac Books and Macs

Best Mac Book overall: Mac Book Air 13-inch M5
Best budget Mac Book: Mac Book Neo
Best Mac: Mac mini (M4)
Best Mac Book Pro Mac Book Pro 14-inch M5
Best Mac for professionals Mac Studio M4 Max

Graham is the Senior Editor for AI at Tech Radar. With over 25 years of experience in both online and print journalism, Graham has worked for various market-leading tech brands including Computeractive, PC Pro, i More, Mac Format, Mac|Life, Maximum PC, and more. He specializes in reporting on everything to do with AI and has appeared on BBC TV shows like BBC One Breakfast and on Radio 4 commenting on the latest trends in tech. Graham has an honors degree in Computer Science and spends his spare time podcasting and blogging.

You must confirm your public display name before commenting

1 Chuwi Au Box X 256V mini PC review: A microcosm of where small PC designs are heading under the current price pressures

2UK Visa Portal website leaks thousands of user passport data and photos online

3A24's Backrooms movie has a 'fairly simple' story, its director says — but the new horror movie doesn't dumb down 'all of the lore' that diehard fans love in order to appeal to a wider audience

4 The long-awaited Fight Club 4K Blu-ray has finally arrived — but not only is it missing Dolby Atmos and Vision, it's also been the subject of controversy on Reddit due to David Fincher's changes

5‘We’ve seen this movie already’ — the Red Magic 11S Pro is blazing fast and games like a champ, but it's far too similar to its predecessor

Tech Radar is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.

Key Takeaways

News, deals, reviews, guides and more on the newest computing gadgets
Start exploring exclusive deals, expert advice and more
Unlock and manage exclusive Techradar member rewards
Unlock instant access to exclusive member features
Get full access to premium articles, exclusive features and a growing list of member rewards