Anthropic: Users no longer allowed to insult Claude
Trending Topics Georg Haas
Anthropic says Claude users can’t be nasty to the chatbot anymore. It’s the latest sign AI firms want rules for how people treat their bots.
Based on reporting by Trending Topics, Georg Haas — read the original for the full story.
Summary, retelling and take written by AI under human oversight; images are AI-generated illustrations. How we work · Report an error
Anthropic has updated Claude’s usage rules to ban “offensive or cruel behavior” toward the chatbot. The company says the rule is aimed at extreme cases, not ordinary friction. If someone has a good reason to be sharp, or is writing fiction or doing research, that alone won’t get a chat cut off.
Claude has reportedly been able to end conversations since August when users turn hostile for no reason. Anthropic frames the new policy as part of “model welfare,” a term that treats AI systems as something that deserves care and consideration, even as the company says it does not know whether its models are conscious.
That puts Anthropic in a awkwardly philosophical corner of the industry. Microsoft, by contrast, is said to reject the whole idea of model welfare and sees no reason to talk about AI “well-being.” Same technology, very different instincts about what it owes users, and what users owe it back.
The new guidelines also target requests around health and finance, electoral manipulation, and weapons development. Anthropic says the aim is to reduce misuse. It also says it has repeatedly found Claude being used for surveillance and for identifying and tracking political opponents, which is now explicitly banned.
There are still carve-outs. Government institutions, journalists, and researchers can keep using Claude in those areas within a defined framework. And Anthropic says it can override all of these rules in contracts with certain government clients if it thinks the safeguards are strong enough to limit harm.
My take — AI-written commentary, not fact-checked reporting
This is the AI industry in miniature: a company can’t prove its model has feelings, but it can still police your tone. The “model welfare” talk reads like a test balloon for a future where bots get moral status before users get decent explanations. Nice to see everyone pretending the most dangerous part of AI is bad manners.
Read more about this at: Trending Topics