Open AI's ‘Trusted Contact’ feature for Chat GPT users in crisis is a sign AI is becoming something much more personal | Tech Radar
Overview
News, deals, reviews, guides and more on the newest computing gadgets
Start exploring exclusive deals, expert advice and more
Details
Unlock and manage exclusive Techradar member rewards.
Unlock instant access to exclusive member features.
Get full access to premium articles, exclusive features and a growing list of member rewards.
Open AI's ‘Trusted Contact’ feature for Chat GPT users in crisis is a sign AI is becoming something much more personal
Chat GPT is evolving from an AI assistant into emotional infrastructure
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.
If there was ever evidence that people are forming deep emotional reliance on Chat GPT, Open AI’s new Trusted Contact feature is probably it.
Speaking at Sequoia Capital’s AI Ascent event last May, Open AI CEO Sam Altman said young people were using Chat GPT like an operating system for life — not just for productivity, but for major personal decisions.
“I mean, that stuff, I think, is all cool and impressive,” Altman said. “And there’s this other thing where, like, they don’t really make life decisions without asking Chat GPT what they should do.”
You can now set a Chat GPT Trusted Contact to alert over safety concerns
Chat GPT’s ‘adult mode’ being shelved reveals a much bigger AI problem
At the time, the comment sounded provocative. A year later, though, Chat GPT has become something closer to a therapist, life coach, confidant, and companion for many of its users. Now Open AI is building an actual emotional-support infrastructure around the chatbot with a feature called Trusted Contact.
Chat GPT will now contact your friends if you need help
The feature is still rolling out, so Trusted Contact is not available to everybody yet, but to find it, you click or tap on your profile name in Chat GPT, then look in Settings. You can nominate a trusted adult contact, who must accept the role before the feature becomes active.
If Chat GPT’s automated systems detect conversations that may indicate a serious risk of self-harm, the user is warned that their Trusted Contact could be notified and encouraged to reach out themselves first.
A specially trained human review team then assesses the situation before any alert is sent. If reviewers believe there is a genuine safety concern, the Trusted Contact receives a notification by email, text, or in-app alert encouraging them to check in.
Open AI says the alerts do not include chat transcripts or detailed conversation history in order to protect user privacy, and you can remove or change your Trusted Contact at any time.
Being contacted by the Trusted Contact feature in Chat GPT on an i Phone. (Image credit: Open AI)
Open AI says Trusted Contact was developed with input from mental-health experts, suicide-prevention specialists, and a global network of more than 260 doctors across 60 countries. Taken together with all the parental controls that Open AI has already introduced and the safety guardrails already in place, Trusted Contact is another sign that the company is acknowledging that Chat GPT is something that can affect users emotionally, not just technologically.
The recent product announcements from Open AI have really played down the use of Chat GPT as a confident, and emphasised Chat GPT's productivity focus more, particularly regarding the Codex tool for creating code. Yet at the same time, more and more safety features aimed at Chat GPT users' emotional well-being are being added.
The idea that we are now being monitored by Chat GPT is also concerning to some. When my colleague Becca Caddy recently interviewed Amy Sutton from Freedom Counselling for an investigation into AI monitoring tools in the workplace, she noted that knowing you're being monitored by your AI, especially in the workplace, could actually worsen the problem it’s trying to solve. Sutton commented, “With mental health stigmas still rife, AI observation would likely lead to greater efforts to hide evidence of struggles. This could create a dangerous spiral, where the greater our efforts to hide low mood or anxiety, the worse it becomes.”
Whether Trusted Contact feels reassuring or unsettling probably depends on how you already see AI and Chat GPT. But the feature is another example of how AI companies acknowledge that their products are not just tools for productivity and information, but as systems people may increasingly rely on emotionally during some of the most vulnerable moments of their lives.
Follow Tech Radar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.
➡️ Read our full guide to the best business laptops
- Best overall: Dell 14 Premium
- Best on a budget: Acer Aspire 5
- Best Mac Book: Apple Mac Book Pro 14-inch (M4)
Graham is the Senior Editor for AI at Tech Radar. With over 25 years of experience in both online and print journalism, Graham has worked for various market-leading tech brands including Computeractive, PC Pro, i More, Mac Format, Mac|Life, Maximum PC, and more. He specializes in reporting on everything to do with AI and has appeared on BBC TV shows like BBC One Breakfast and on Radio 4 commenting on the latest trends in tech. Graham has an honors degree in Computer Science and spends his spare time podcasting and blogging.
You must confirm your public display name before commenting
1 Open AI's ‘Trusted Contact’ feature for Chat GPT users in crisis is a sign AI is becoming something much more personal
2 This 'impressively rugged' portable power station 'opens up entirely new possibilities for living completely off-grid' — and it just got a massive discount ahead of festival season
3‘Dizziness, nausea, vertigo, and sleep disruption’: The undetectable hum of AI data centers is making local residents sick
4 The Steam Machine has a new reference in Steam's database, and it means we could be seeing it arrive very soon
5'Completely off the rails': Tik Tok is scaling back its AI summaries feature after it creates bizarre and inaccurate captions — as if Tik Tok wasn't bad enough for misinformation already
Tech Radar is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.
© Future US, Inc. Full 7th Floor, 130 West 42nd Street, New York, NY 10036.
Key Takeaways
- News, deals, reviews, guides and more on the newest computing gadgets
- Start exploring exclusive deals, expert advice and more
- Unlock and manage exclusive Techradar member rewards
- Unlock instant access to exclusive member features
- Get full access to premium articles, exclusive features and a growing list of member rewards
