Anthropic gives METR inside access to audit its AI models and safety practices

Anthropic has given a team from the nonprofit METR inside access to review its AI models and safety practices, the company announced. Six METR staffers received company hardware, office space, and access to internal tools, which Anthropic says puts them roughly on par with its own risk teams.

Customer data, information covered by attorney-client privilege, and details about the model architecture remain off-limits. METR will publish its findings independently. Anthropic says it can ask for redactions in certain predefined categories, but METR is free to say publicly whether it thinks those redactions were justified.

Anthropic argues that not all safety-relevant information can be made public, either because it could help attackers or because it's commercially sensitive. The METR deal goes further than what the company has offered other outside reviewers. SecureBio, Accenture, and Faculty have so far received less access and tighter limits on what they can publish, and Anthropic has started early talks with Hugging Face. The move follows Anthropic's signing of the White House Accord on Super Intelligence, which includes a commitment to working with outside reviewers.Ad

Ad