Anthropic changes usage policy to ban model abuse and election interference

Anthropic updated its usage policy on Thursday, codifying new prohibitions on election interference, weapons software, and surveillance. But perhaps the most attention-getting change is a new prohibition against prolonged verbal abuse of the model, which is now expressly forbidden.

Since an update in August, Claude has been trained to end conversations with “persistently harmful or abusive user interactions” — but the new policy explicitly bars users from pursuing those conversations.

“The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose,” the post explains. “It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research.”

The change comes after Anthropic has sought out collaborations with prominent religious scholars — in some cases, seeking to convince them that Claude could be conscious or have a soul.

Separate sections of the usage policy forbid users from engaging in broadly deceptive campaigns, such as using Claude to run fake accounts or fabricated news outlets. The policy also includes rules against deceiving voters or disrupting elections, collected in a section titled “Do Not Undermine Democratic Processes.”

Get 50% off a second pass

The Disrupt experience is meant to be shared. Get your pass and bring a colleague, partner, or peer at 50% off. Cover more ground by making connections, building momentum, and discovering what’s next in the startup ecosystem.

Every weekday and Sunday, you can get the best of TechCrunch’s coverage.

TechCrunch Mobility is your destination for transportation news and insight.

Startups are the core of TechCrunch, so get our best coverage delivered weekly.

Provides movers and shakers with the info they need to start their day.

By submitting your email, you agree to our Terms and Privacy Notice.