Claude Can Now Stop Conversations - for Its Own Protection, Not Yours

Claude can now stop conversations - for its own protection, not yours

The company has given its AI chatbot the ability to end toxic conversations as part of its broader 'model welfare' initiative.

Be Nice: Claude Will End Chats If You're Persistently Harmful or Abusive

'This ability is intended for use in rare, extreme cases,' Anthropic says.

Anthropic says Claude chatbot can now end harmful, abusive interactions

Harmful, abusive interactions plague AI chatbots. Researchers have found that AI companions like Character.AI, Nomi, and Replika are unsafe for teens under 18, ChatGPT has the potential to reinforce users’ delusional thinking, and even OpenAI CEO Sam Altman has spoken about ChatGPT users developing an "emotional reliance" on AI. Now, the companies that built these tools are slowly rolling out features that can mitigate this behavior.On Friday, A…

Claude AI will end ‘persistently harmful or abusive user interactions’

Anthropic’s Claude AI chatbot can now end conversations deemed “persistently harmful or abusive,” as spotted earlier by TechCrunch. The capability is now available in Opus 4 and 4.1 models, and will allow the chatbot to end conversations as a “last resort” after users repeatedly ask it to generate harmful content despite multiple refusals and attempts at redirection. The goal is to help the “potential welfare” of AI models, Anthropic says, by te…

Why Anthropic is letting Claude walk away from you — but only in 'extreme cases'

Anthropic says its AI can now end extreme chats when users push too far.Smith Collection/Gado/Getty ImagesPush too far and Claude will end the chat.Anthropic said its Opus 4 and 4.1 models can walk away from extreme chats, including child exploitation requests.Most users "will not notice or be affected by this feature in any normal product use," it added.Claude isn't here for your toxic conversations.In a blog post on Saturday, Anthropic said it…

Anthropic’s Claude AI will now cut off abusive chats with users for its own ‘welfare’

A recent study found that AI chatbots showed signs of stress and anxiety when users shared “traumatic narratives” about crime, war, or car accidents.