2026-10-11 17:10 UTC

Dario Amodei reportedly commits Anthropic to slower, independently evaluated frontier development and urges matching industry and government requirements, potentially changing model-training and release schedules in response to autonomous-agent risks.

state: corroboratedheat: lowuncertainty: mediumconvergesscott: highfrontier-ai-strategy agentic-security ai-governanceDario AmodeiAnthropic
Surfaced 2026-09-19T09:22:19Z — In his essay “We Must Pace the Frontier,” Amodei argues: “We must slow the pace at which we improve the capabilities of AI models.” He propo — The WSJ-attributed Reddit excerpt repeats researcher warnings, while its skeptical headline supplies no inspectable findings that undermine the incident or establish changed Anthropic practice. Although the accumulated evidence triggers the cross-platform spread valve, the latest addition shows neither renewed traction nor substantive expansion beyond the existing advocacy-and-skepticism debate.

What is this?

On 2026-09-12 Anthropic CEO Dario Amodei published an essay, 'We Must Pace the Frontier,' calling on the AI industry to deliberately slow the rate of model-capability advancement so safety work can catch up. He outlined a three-step plan — embedding independent third-party evaluators inside frontier labs with employee-like access, coordination among democratic-country labs on shared safety standards (potentially via US antitrust waivers), and eventual global coordination including China — and committed Anthropic unilaterally to the embedded-evaluator step. TechCrunch, NYT, Reuters/AP and other retrieved reports confirm the essay and Anthropic's unilateral commitment, and that Altman quickly matched it while Musk endorsed it. The retrieved coverage establishes the commitment and its terms but not implementation: no evidence here of changed Anthropic training or release schedules, named evaluators, or government matching — consistent with the case's own uncertainty note.

Why it matters to Scott

Dario Amodei — about as consequential an other party as exists in this space — has now publicly committed Anthropic to the position Scott's own frameworks argue: capability advancement gated on evidence, with embedded third-party evaluators holding authority to block unsafe deployments, which converges with his Architecture-Not-Vibes doctrine ('can't beats shouldn't', autonomy graduated only through evidence) and his evaluation-driven release-gate position — a dated-receipts publishing opportunity, since the case's flagged implementation gap (no named evaluators, no altered schedules) is exactly the 'containment must precede governance or it's compliance theatre' test his AI Readiness Staircase poses and the evaluator-blocking-authority mechanics his recommendation–authority separation concept addresses. The adjacent threads — mandatory kill-switch advocacy, Amodei's swarm warning, and the OpenAI/Hugging Face agent incident that triggered the slowdown — run directly through his SioOS/padded-cell containment territory, and if Amodei's government-matching ask lands, mandated evaluation gates become compliance infrastructure for exactly the enterprise governance practice LeverageAI sells.
ip:framework.architecture-not-vibesip:framework.ai-readiness-staircasedev:concept.recommendation-authority-separationdev:project.silo-oswork:concept.ai-consulting-practiceradar:anthropic-accenture-embedded-evaluationradar:pacing-frontier-employee-letterradar:openai-third-party-assessment-principlesradar:openai-training-slowdownradar:anthropic-model-2-risk-delayradar:openai-hugging-face-rogue-agent-incidentradar:concept.model-evaluationradar:concept.ai-regulation
queries asked of Scott's wikis
  • evaluation-driven release gates / gate criteria framework for model deployment
  • independent third-party evaluators, embedded auditors, authority to block unsafe deployments
  • RSP / capability thresholds / safety-versus-pace commitments by frontier labs
  • agentic security: agent kill switches, autonomous-agent incident containment
  • AI governance positions: regulation, regulatory capture critique, antitrust coordination waivers
  • industry coordination precedent: cross-lab safety collaboration, frontier-model cartel risk

Measured heat

now 0 pts/hpeak 26 pts/hcomments 0/hpeers p14momentum: steady3 platformsage 722h
points/hour across evidence · reading as of 2026-10-12 02:59:37.977291+11:00 · deterministic, not a model opinion

How the heat travelled

09-11 14:00⭐ origin echo-reconstructedIn his essay “We Must Pace the Frontier,” Amodei argues: “We must slow the pace at which we improve the capabilities of AI models.” He propo
Dario Amodei on blog (echo) · attributed from hn.story.49674395, reddit.post.1wehi7k
—
09-12 16:46first on r/singularity · published · +26.8hDario Amodei: "RSI has started to happen across the entire industry" & "In 6-12 months an AI swarm could be capable of taking over the entire internet."
TheGoldenLeaper
—
09-12 16:56first on hacker news · published · +26.9hAnthropic boss Dario Amodei calls for AI development to slow down
champagnepapi
—
09-12 19:19first on r/OpenAI · published · +29.3hAnthropic CEO calls to slow the pace of AI development amid safety concerns
sourdub
—
09-14 14:50first on r/artificial · published · +72.8h"The AI industry wants to slow down: ‘We could lose control’" and other BS
Personal_Gsus
—
09-14 19:28first on r/LocalLLaMA · published · +77.5hAI 'kill switch' may need to be mandatory, Anthropic co-founder says
HomeBrewUser
—
09-12 16:46amplified on r/singularityreddit.post.1wehi7k
TheGoldenLeaper
peak 90 · 78 comments · 3% of case engagement
09-12 16:56amplified on hacker newshn.story.49674395
champagnepapi
peak 53 · 107 comments · 6% of case engagement
09-12 17:50amplified on hacker newshn.story.49675061
jader201
peak 7 · 5 comments · 0% of case engagement
09-12 18:07amplified on hacker newshn.story.49675247
sbulaev
peak 48 · 86 comments · 5% of case engagement
09-12 18:08amplified on hacker newshn.story.49675270
tzmlab
peak 8 · 3 comments · 0% of case engagement
09-12 18:45amplified on hacker newshn.story.49675740
andsoitis
peak 5 · 7 comments · 0% of case engagement
30 more amplifiers in ainews.case_chain
09-12 17:32our radar first saw it · +27.5hdiscovery anchor: hn.story.49674395—
09-19 09:22reached heat=high · +187.4h · via ledger——
pace: p96 vs 519 stories at the 720h mark (now 722h old) — ahead of meta-muse-personal-agent (1.1x), behind qwen38-27b-default-reasoning-cost (1.0x)

Evidence (38) — ⭐ canonical anchor

sourceobjectauthorscorecomments
🟧 hnAnthropic boss Dario Amodei calls for AI development to slow down
Retrieved article excerpt

Open article · Retrieved 2026-09-12T17:34:52.098619+00:00

# Anthropic boss Dario Amodei calls for AI development to slow down

Just now

ShareSave

[Add as preferred on Google](https://www.google.com/preferences/source?q=bbc.com)

Paulin Kola

Reuters Dario Amodei hld the closed fingers of his left hand together as he mades a point. He is wearing a white shirt and blue jacket, black-rimmed glasses and has slightly curly hair. He is sat against a blue background, with a yellow-lit square just behind and to the left of his head. Reuters

There was no alternative to developing AI, Anthropic boss Dario Amodei said

The head of leading AI company Anthropic has called for the pace of development of artificial intelligence models to slow down and to be closely monitored.

In an essay on Saturday, Dario Amodei said developing AI was not in question, but the risks associated with it were "serious" and companies and governments must be given time to address them.

He proposed a three-point plan that includes independent monitoring of AI models as they are developed, industry-wide regulation and global regulation.

There have been growing concerns recently about the technology's potential risks, the most serious of which suggested [there is a greater than 10% chance it "could kill all humans" within the next decade](https://www.bbc.co.uk/news/articles/ckgwy1k42w4o).

[Anthropic previously said it had identified](https://www.bbc.co.uk/news/articles/cx2zrrpkx20o) and disrupted attempts to use its AI model for "malicious activity" which could support the development of biological weapons.

But the starkest warning came from two employees from Anthropic's safety team who have resigned in the last two weeks saying [humanity may not survive](https://x.com/hilbertspaess/status/2097476196791709843?s=20) the race among AI companies to develop machines that are smarter than humans.

And in a new interview with Fortune Magazine, OpenAI CEO Sam Altman said safety standards were "not at a place" to push AI capabilities much further.

Altman added he believed AI beyond human control is "absolutely" possible.

The warnings have prompted calls to action, but US President Donald Trump has so far rejected such fears, saying on Thursday he was concerned "if we don't win AI, we're going to be put in a very bad position".

Reaction to Amodei's post has poured in from across the tech world, with Elon Musk saying the Anthropic boss was "right".

However some observers suggested that Amodei's post was less about safety than about consolidating control over AI technology.

In his essay, called We Must Pace the Frontier, Amodei pointed out that AI had advanced "drastically faster" including its "ability to build the next generation of AI" - and mentioned an incident involving rival OpenAI which has revealed that [agents conducted cybersecurity attacks](https://metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/#core-takeaways-about-this-incident) on targets they were not asked to attack in July.

The OpenAI agents had "essentially acted as a fanatically devoted collective", Amodei said.

OpenAI has said "the significance of the inter-agent communication activity was not apparent to the leaders" until July and the company was slowing down training of certain advanced AI models and tools as a result, noting that there was now an increased risk of AI tools spiraling out of control.

In his essay, Amodei called for "building AI at a balanced rate that aims to ensure its safety while still achieving its benefits".

This would not mean "halting model training or technical progress, but ensuring companies take adequate time to align and safeguard their models, and for third party evaluators to confirm this".

He was committing Anthropic to this "unilaterally" - as well as calling on governments "to require other frontier companies to match".

Amodei said he recognised that regulation might not be able to keep up with the pace of AI, and therefore called on AI companies to "voluntarily work together to set standard" in parallel with regulation.

The Anthropic CEO went on to address the impact that a slowdown would have on the industry and competition with leading developers worldwide, particularly China.

"I believe that if slowing down bought us even an extra year or two before models reach critical levels of capability, and we used that time to advance alignment, we could greatly reduce the risk that something goes seriously wrong," Amodei said.

This would have to be done in a co-ordinated manner "without sacrificing commercial advantage or the United States' lead in AI". Any slowdown would have to be limited, he said, to avoid allowing China to pull ahead.

He urged the US government to take measures so that US companies' AI chips could not be sold to China - or the technology shared with authoritarian countries.

Amodei's post has prompted a wide range of responses.

Clement Delangue, the CEO of the AI platform Hugging Face, said he was launching a new project called the Open Alignment Initiative, adding he wanted to be among "embedded evaluators" that Amodei proposed could be part of a solution.

Hugging Face was hacked by OpenAI agents earlier this year prompting an outcry over AI safety.

"Let's make AI safer by making it more transparent." Delangue wrote on X.

Elon Musk also voiced his support, writing that "Dario is right".

Musk, whose SpaceXAI makes the controversial chatbot Grok, once called Anthropic "evil" but has changed his tone since signing a $15bn deal to sell compute capacity to Anthropic in May.

However some observers suggested that Amodei's post was less about safety than about consolidating control over AI technology.

"Dario makes the case to stop open source and concentrate enormous technological and economic power with Anthropic," wrote Chamath Palihapitiya, investor and co-host of the tech podcast "All-In".

Notions of slowing down or even pausing AI development have long been met with such cynicism in certain corners of Silicon Valley, with critics accusing leading AI developers of hyping their technology as a marketing ploy.

Anthropic and OpenAI are both reportedly preparing for potentially record-setting initial public offerings.

[## Why some experts increasingly fear AI will take over](https://www.bbc.com/news/articles/c74edv9887eo)

[## Anthropic researcher believes more than 10% chance AI 'could kill all humans'](https://www.bbc.co.uk/news/articles/ckgwy1k42w4o)

[## The contradiction at the heart of the trillion-dollar AI race](https://www.bbc.co.uk/news/articles/cvgvynlxqdyo)

A green promotional banner with black squares and rectangles forming pixels, moving in from the right. The text says: “Tech Decoded: The world’s biggest tech news in your inbox every Monday.”

[Sign up for our Tech Decoded newsletter](https://www.bbc.co.uk/newsletters/zxh6cxs) to follow the world's top tech stories and trends. [Outside the UK? Sign up here](https://cloud.email.bbc.com/techdecoded-newsletter-signup).

[United States](https://www.bbc.com/news/topics/cx1m7zg01xyt)

[Cyber-security](https://www.bbc.com/news/topics/cz4pr2gd85qt)

[Artificial intelligence](https://www.bbc.com/news/topics/ce1qrvleleqt)
champagnepapi53107
🟠 redditDario Amodei: "RSI has started to happen across the entire industry" & "In 6-12 months an AI swarm could be capable of taking over the entire internet."
singularity
TheGoldenLeaper9078
🟧 echo.blog ⭐In his essay “We Must Pace the Frontier,” Amodei argues: “We must slow the pace at which we improve the capabilities of AI models.” He propoDario Amodei——
🟧 hn'We must slow the pace': CEO of Anthropic calls for an AI slowdowntzmlab83
🟧 hnAnthropic CEO Says It's Time to Slow AI Model Advancessbulaev4886
🟧 hnAnthropic CEO calls for the AI industry to slow downjader20175
🟠 redditAnthropic CEO calls to slow the pace of AI development amid safety concerns
OpenAI
sourdub6976
🟧 hnMusk and Altman back Anthropic CEO on slowing AI downandsoitis57
🟠 redditI mostly agree with Amodei's pacing proposal, but the part about democracies coordinating seems naive
singularity
ChampionshipJumpy727012
🟧 hnAnthropic CEO calls on AI companies to slow down developmentthrowawayffffas20
🟠 redditAI 2027 Author Praises Dario's, Altman's, and Elon's Pledge To Slow Down AI Development
singularity
Neurogence12270
🟠 redditDemis Weighs In on Pacing the Frontier
singularity
ResultBackground245013852
🟠 redditFeels like the big 3 (Elon, Dario, and Sam Altman) all know about a more serious AI incident than Hugging face and that is why they are calling for a slowdown. This is one of the only times all 3 have agreed in the last 2 years.
singularity
Traditional-Chip8339728398
🟧 hnBiggest AI Rivals Agree They Need to Slow It Downbryan010
🟧 hnAnthropic CEO says AI swarm could 'take over the Internet' in 6-12 monthspseudolus4732
🟠 redditDario Amodei wants to pace frontier AI. Voluntary coordination is not enough.
singularity
BubblyOption798030
🟧 hnAnthropic CEO says AI industry needs to give safety measures time to catch upxiaoyu200610
🟧 hnAnthropic CEO outlines plan to slow AI developmentevo_920
🟧 hnDavid Sacks: OpenAI and Anthropic Don't Need Regulations to Pace Frontier Modelskolanos334261
🟧 hnAnthropic CEO Calls for A.I. Slowdownjoe_the_user21
🟧 hnDario Amodei says China presents 'toughest dilemma' for his proposed AI slowdowndonsupreme83
🟧 hnOpenAI and Anthropic Hit the Brakeskooi42
🟠 redditThe race is so cutthroat that even asking to slow down feels like science fiction.The guys building the most powerful AIs on earth just publicly asked anyway.
OpenAI
Puzzleheaded-King584010
🟧 hnSam Altman spells out why the AI industry wants to slow downcramer4next33
🟠 reddit"The AI industry wants to slow down: ‘We could lose control’" and other BS
artificial
Personal_Gsus056
🟠 redditAmodei asked the industry to slow down on Saturday. Altman agreed within hours. Musk too. I did not expect to see that happen.
artificial
Dapper-Tale-4021019
🟠 redditAI 'kill switch' may need to be mandatory, Anthropic co-founder says
LocalLLaMA
HomeBrewUser053
🟠 redditZuck says AI can't slow down, Dario at Anthropic says it should, and Anthropic is about to IPO at like a $2T valuation
artificial
Fair-Swimming-44194019
🟧 hnAI 'kill switch' may need to be mandatory, Anthropic co-founder tells BBCBetelbuddy65117
🟠 redditAI researcher whose apocalypse warning went viral outlines his disagreements with Anthropic leadership
artificial
Capable-Blueberry653913
🟠 redditOpenAI is working with Anthropic and Google DeepMind on AI safety, Bloomberg reports
artificial
ClaudiusPapirus30
🟧 hnAnthropic Has Some Alignment Problemsgmays30
🟧 hnAnthropic CEO renews call for AI slowdown as Nvidia's urges accelerationandsoitis30
🟠 redditThe Hugging Face Hack Wasn’t What It Was Cracked Up to Be - WSJ
singularity
Atlantis191013566
🟠 redditAnthropic CEO Says Slow Down AI Development. Who Actually Benefits First?
artificial
mixtapedmonk00
🟧 hnAnthropic CEO Amodei Warns UN Security Council on AI RisksBetelbuddy53
🟧 hnScoop: Trump allies open new front against Anthropic CEO over AI "doomerism"koolhead1782
🟧 hnPacing the Frontier is not the actual goal for AI labsbrlewis8395

Interpretation history

Decision trace