# Anthropic drafts AI safety bill that could block models posing deadly risk

> Anthropic proposes a Congress bill that would halt AI model releases if they could cause 50 deaths or $1 billion in damage, using independent evaluators.

Oossa · 2026-10-20 · https://oossa.com/en/anthropic-drafts-ai-safety-bill-that-could-block-models-posing-deadly-risk

Anthropic has circulated a draft bill that asks Congress to let the U.S. Commerce Department stop the distribution of an AI model when an "imminent catastrophic risk" is identified. The bill defines that risk as one that could kill more than 50 people or cause over a billion dollars in property damage. The danger must come from a biological weapon, the model escaping its controls, or a cyber‑attack.

## How the bill would work

The proposal calls for "independent evaluators" registered with the Commerce Department to assess a model’s risk. Evaluators could be paid by AI labs, but the payment could not be tied to the outcome of the assessment. If an evaluator flags a risk, they have 72 hours to notify the Commerce Department, which must then ask a D.C. judge to order a halt on the model’s release. The bill bars any federal agency from stopping a model on its own.

## Industry response

Anthropic says the bill reflects its Advanced AI Framework, which it has been promoting to lawmakers since June. The company has not commented further. Other AI firms have pushed for voluntary internal monitors rather than mandatory oversight, and Nvidia’s CEO has argued the industry needs no new laws.

## The facts

- The draft bill would block a model if it poses a "foreseeable, imminent risk" of over 50 deaths or more than $1 billion in property damage.
- Risk assessments would be done by independent evaluators registered with the U.S. Commerce Department.
- Evaluators have 72 hours to alert the Commerce Department, which must then seek a D.C. judge’s order to halt the model.
- The bill forbids any federal agency from independently stopping a model’s distribution.
- Anthropic has been promoting its Advanced AI Framework to federal and state lawmakers since June.

## Why it matters

If adopted, the bill could stop the release of AI systems that pose severe safety threats, giving the public a legal backstop against extreme harms. For developers, it would add a new compliance step before launching powerful models. It remains unclear how independent the evaluations would be or how quickly courts could act in practice.

## Sources & references

1. [Anthropic pitches AI safety bill that may block a model if 50+ people could be killed](https://techcrunch.com/2026/10/20/anthropic-pitches-ai-safety-bill-that-may-block-a-model-if-50-people-could-be-killed/) – TechCrunch, 2026-10-20

Last updated: 2026-10-20