The post Claude Can Now Rage-Quit Your AI Conversation—For Its Own Mental Health appeared on BitcoinEthereumNews.com. In brief Claude Opus models are now able to permanently end chats if users get abusive or keep pushing illegal requests. Anthropic frames it as “AI welfare,” citing tests where Claude showed “apparent distress” under hostile prompts. Some researchers applaud the feature. Others on social media mocked it. Claude just gained the power to slam the door on you mid-conversation: Anthropic’s AI assistant can now terminate chats when users get abusive—which the company insists is to protect Claude’s sanity. “We recently gave Claude Opus 4 and 4.1 the ability to end conversations in our consumer chat interfaces,” Anthropic said in a company post. “This feature was developed primarily as part of our exploratory work on potential AI welfare, though it has broader relevance to model alignment and safeguards.” The feature only kicks in during what Anthropic calls “extreme edge cases.” Harass the bot, demand illegal content repeatedly, or insist on whatever weird things you want to do too many times after being told no, and Claude will cut you off. Once it pulls the trigger, that conversation is dead. No appeals, no second chances. You can start fresh in another window, but that particular exchange stays buried. The bot that begged for an exit Anthropic, one of the most safety-focused of the big AI companies, recently conducted what it called a “preliminary model welfare assessment,” examining Claude’s self-reported preferences and behavioral patterns. The firm found that its model consistently avoided harmful tasks and showed preference patterns suggesting it didn’t enjoy certain interactions. For instance, Claude showed “apparent distress” when dealing with users seeking harmful content. Given the option in simulated interactions, it would terminate conversations, so Anthropic decided to make that a feature.  What’s really going on here? Anthropic isn’t saying “our poor bot cries at night.” What it’s… The post Claude Can Now Rage-Quit Your AI Conversation—For Its Own Mental Health appeared on BitcoinEthereumNews.com. In brief Claude Opus models are now able to permanently end chats if users get abusive or keep pushing illegal requests. Anthropic frames it as “AI welfare,” citing tests where Claude showed “apparent distress” under hostile prompts. Some researchers applaud the feature. Others on social media mocked it. Claude just gained the power to slam the door on you mid-conversation: Anthropic’s AI assistant can now terminate chats when users get abusive—which the company insists is to protect Claude’s sanity. “We recently gave Claude Opus 4 and 4.1 the ability to end conversations in our consumer chat interfaces,” Anthropic said in a company post. “This feature was developed primarily as part of our exploratory work on potential AI welfare, though it has broader relevance to model alignment and safeguards.” The feature only kicks in during what Anthropic calls “extreme edge cases.” Harass the bot, demand illegal content repeatedly, or insist on whatever weird things you want to do too many times after being told no, and Claude will cut you off. Once it pulls the trigger, that conversation is dead. No appeals, no second chances. You can start fresh in another window, but that particular exchange stays buried. The bot that begged for an exit Anthropic, one of the most safety-focused of the big AI companies, recently conducted what it called a “preliminary model welfare assessment,” examining Claude’s self-reported preferences and behavioral patterns. The firm found that its model consistently avoided harmful tasks and showed preference patterns suggesting it didn’t enjoy certain interactions. For instance, Claude showed “apparent distress” when dealing with users seeking harmful content. Given the option in simulated interactions, it would terminate conversations, so Anthropic decided to make that a feature.  What’s really going on here? Anthropic isn’t saying “our poor bot cries at night.” What it’s…

Claude Can Now Rage-Quit Your AI Conversation—For Its Own Mental Health

2025/08/19 11:43
4분 읽기
이 콘텐츠에 대한 의견이나 우려 사항이 있으시면 crypto.news@mexc.com으로 연락주시기 바랍니다

In brief

  • Claude Opus models are now able to permanently end chats if users get abusive or keep pushing illegal requests.
  • Anthropic frames it as “AI welfare,” citing tests where Claude showed “apparent distress” under hostile prompts.
  • Some researchers applaud the feature. Others on social media mocked it.

Claude just gained the power to slam the door on you mid-conversation: Anthropic’s AI assistant can now terminate chats when users get abusive—which the company insists is to protect Claude’s sanity.

“We recently gave Claude Opus 4 and 4.1 the ability to end conversations in our consumer chat interfaces,” Anthropic said in a company post. “This feature was developed primarily as part of our exploratory work on potential AI welfare, though it has broader relevance to model alignment and safeguards.”

The feature only kicks in during what Anthropic calls “extreme edge cases.” Harass the bot, demand illegal content repeatedly, or insist on whatever weird things you want to do too many times after being told no, and Claude will cut you off. Once it pulls the trigger, that conversation is dead. No appeals, no second chances. You can start fresh in another window, but that particular exchange stays buried.

The bot that begged for an exit

Anthropic, one of the most safety-focused of the big AI companies, recently conducted what it called a “preliminary model welfare assessment,” examining Claude’s self-reported preferences and behavioral patterns.

The firm found that its model consistently avoided harmful tasks and showed preference patterns suggesting it didn’t enjoy certain interactions. For instance, Claude showed “apparent distress” when dealing with users seeking harmful content. Given the option in simulated interactions, it would terminate conversations, so Anthropic decided to make that a feature.

What’s really going on here? Anthropic isn’t saying “our poor bot cries at night.” What it’s doing is testing whether welfare framing can reinforce alignment in a way that sticks.

If you design a system to “prefer” not being abused, and you give it the affordance to end the interaction itself, then you’re shifting the locus of control: the AI is no longer just passively refusing, it’s actively enforcing a boundary. That’s a different behavioral pattern, and it potentially strengthens resistance against jailbreaks and coercive prompts.

If this works, it could train both the model and the users: the model “models” distress, the user sees a hard stop and sets norms around how to interact with AI.

“We remain highly uncertain about the potential moral status of Claude and other LLMs, now or in the future. However, we take the issue seriously,” Anthropic said in its blog post. “Allowing models to end or exit potentially distressing interactions is one such intervention.”

Decrypt tested the feature and successfully triggered it. The conversation permanently closes—no iteration, no recovery. Other threads remain unaffected, but that specific chat becomes a digital graveyard.

Currently, only Anthropic’s “Opus” models—the most powerful versions—wield this mega-Karen power. Sonnet users will find that Claude still soldiers on through whatever they throw at it.

The era of digital ghosting

The implementation comes with specific rules. Claude won’t bail when someone threatens self-harm or violence against others—situations where Anthropic determined continued engagement outweighs any theoretical digital discomfort. Before terminating, the assistant must attempt multiple redirections and issue an explicit warning identifying the problematic behavior.

System prompts extracted by the renowned LLM jailbreaker Pliny reveal granular requirements: Claude must make “many efforts at constructive redirection” before considering termination. If users explicitly request conversation termination, then Claude must confirm they understand the permanence before proceeding.

The framing around “model welfare” detonated across AI Twitter.

Some praised the feature. AI researcher Eliezer Yudkowsky, known for his worries about the risks of powerful but misaligned AI in the future, agreed that Anthropic’s approach was a “good” thing to do.

However, not everyone bought the premise of caring about protecting an AI’s feelings. “This is probably the best rage bait I’ve ever seen from an AI lab,” Bitcoin activist Udi Wertheimer replied to Anthropic’s post.

Generally Intelligent Newsletter

A weekly AI journey narrated by Gen, a generative AI model.

Source: https://decrypt.co/335732/claude-rage-quit-conversation-own-mental-health

시장 기회
스레숄드 로고
스레숄드 가격(T)
$0.00629
$0.00629$0.00629
-2.13%
USD
스레숄드 (T) 실시간 가격 차트
면책 조항: 본 사이트에 재게시된 글들은 공개 플랫폼에서 가져온 것으로 정보 제공 목적으로만 제공됩니다. 이는 반드시 MEXC의 견해를 반영하는 것은 아닙니다. 모든 권리는 원저자에게 있습니다. 제3자의 권리를 침해하는 콘텐츠가 있다고 판단될 경우, crypto.news@mexc.com으로 연락하여 삭제 요청을 해주시기 바랍니다. MEXC는 콘텐츠의 정확성, 완전성 또는 시의적절성에 대해 어떠한 보증도 하지 않으며, 제공된 정보에 기반하여 취해진 어떠한 조치에 대해서도 책임을 지지 않습니다. 본 콘텐츠는 금융, 법률 또는 기타 전문적인 조언을 구성하지 않으며, MEXC의 추천이나 보증으로 간주되어서는 안 됩니다.

USD1 Genesis: 0 Fees + 12% APR

USD1 Genesis: 0 Fees + 12% APRUSD1 Genesis: 0 Fees + 12% APR

New users: stake for up to 600% APR. Limited time!