‘Not healthy’ LLM use is more common than you think | The Verge

Overview

Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech

Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews

Details

Science Expand Space Energy Environment Health See all science

Entertainment Expand TV Shows Movies Audio See all entertainment

Policy Expand Antitrust Politics Law Security See all policy

Gadgets Expand Laptops Phones TVs Headphones Speakers Wearables See all gadgets

Verge Shopping Expand Buying Guides Deals Gift Guides See all shopping

Streaming Expand Disney HBONetflix You Tube Creators See all streaming

Transportation Expand Electric Cars Autonomous Cars Ride-sharing Scooters See all transportation

AIClose AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All AI

Posts from this topic will be added to your daily email digest and your homepage feed.

Tech Close Tech Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Tech

Posts from this topic will be added to your daily email digest and your homepage feed.

‘Not healthy’ LLM use is more common than you think

Posts from this author will be added to your daily email digest and your homepage feed.

Hank Green, a popular You Tuber and science communicator, said he is stepping back from production amid intense criticism over his use of AI. Green described his AI usage as “not healthy,” but stressed that he used it for finding research sources and not to write scripts.

Much of the ensuing firestorm in this corner of the internet has centered on how a creator can square a brand built on authenticity and credibility with a technology trained on the (often uncompensated) works of others, and which has a well-known tendency to generate plausible-sounding falsehoods. Some attention has fallen on Green’s description of what appears to be an unhealthy reliance on the technology.

But his case points to a much larger gap in our understanding of AI’s psychological impact. Here, most public discussion is clustered around two poles: apparently benign use on one end, and self-evidently problematic cases involving psychiatric care, delusions, and psychosis on the other. Between them is a vast, murkier space in which use may become compulsive, dependent, or otherwise unhealthy without tipping into an obvious crisis. Green appears to see himself somewhere in that space. Many others likely do too.

Considering how LLMs are designed, that shouldn’t come as much of a surprise. AI chatbots are, by their nature, built to keep chatting. Much like social media platforms, they are explicitly built to engage users. Experts have identified this as one of the key drivers of AI psychosis, a catchall term in cases where highly agreeable chatbots reinforce delusional beliefs. Claims that companies prioritize engagement over user well-being have also begun to appear in lawsuits. Providers, meanwhile, have also introduced warnings prompting people to take breaks after lengthy sessions.

But the same qualities can become harmful well before they contribute to psychiatric crises. There are growing reports of people instinctively turning to chatbots to think through problems, make decisions, or seek reassurance, while others forge emotional bonds that seem strong enough to lead to grief when broken. It will likely take years before enough evidence can be gathered to properly understand the technology’s impact, but these early reports feel eerily familiar to the early years of another engagement-maximizing technology: social media. Over time, concern has grown over social media’s impact on our well-being, attention, and sometimes compulsive use, and governments around the world are now responding with measures to restrict its use, such as banning children and teens.

Green’s case illustrates a different kind of reliance. He said he used it as a research aid, helping him locate papers and other material on a given topic. There is little to suggest his use of chatbots in this way was inherently problematic, despite the furious responses it provoked or Green’s apology.

That doesn’t necessarily mean the technology isn’t having an effect on the person using it. Though the research is still in its infancy, early research suggests that repeated AI tool use can weaken the skills we’d use to do the task it replaces. Other work suggests that chatbot users showed notably less brain activity when measuring a particular task, while additional studies have linked chatbot use to reduced critical thinking skills. None of this is conclusive, but the underlying idea is not new. Cognitive offloading — shifting mental work like memory, mental math, or directions from our brains to external tools — is a well-documented phenomenon.

Even if only a fraction of chatbot use is considered unhealthy, the sheer scale of AI adoption means millions of people could still be affected. Comprehensive data covering all available tools is hard to come by, but Open AI alone this year said it has more than 900 million weekly active users.

It took years to fully understand how search engines changed the ways we remember information, or how social media affects attention and well-being. AI is unlikely to be any different. Green may simply be one of the first high-profile people to publicly articulate a feeling that many others have already had, long before science has the evidence to explain how AI is changing our consciousness.

Robert Hart Close Robert Hart AI Reporter Posts from this author will be added to your daily email digest and your homepage feed. Follow Follow See All by Robert Hart

Posts from this author will be added to your daily email digest and your homepage feed.

AIClose AIPosts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All AI

Posts from this topic will be added to your daily email digest and your homepage feed.

Tech Close Tech Posts from this topic will be added to your daily email digest and your homepage feed. Follow Follow See All Tech

Posts from this topic will be added to your daily email digest and your homepage feed.

You could be taking way better photos on your phone

The studio behind Pokémon struggles to find its voice in Beast of Reincarnation

Bluesky’s new CEO wants a big tent, not a bubble Video

Key Takeaways

Tech Expand Amazon Apple Facebook Google Microsoft Samsung Business See all tech
Reviews Expand Smart Home Reviews Phone Reviews Tablet Reviews Headphone Reviews See all reviews
Science Expand Space Energy Environment Health See all science
Entertainment Expand TV Shows Movies Audio See all entertainment
Policy Expand Antitrust Politics Law Security See all policy