Should AI Development Slow Down? What "Pacing the Frontier" Actually Proposes
Scope: this page separates claims that can be checked against public records from claims that are judgments about uncertain futures. It does not assess whether advanced AI poses existential risk. Where a number is an estimate rather than a disclosure, it is labeled as one.
Within four days in September 2026, the heads of Anthropic, OpenAI, Google DeepMind, and Microsoft publicly aligned around a position that would have been fringe inside the industry two years earlier: the pace of frontier model development should slow. Within the same week, the chief executive of the company selling most of the chips said the premise was wrong, and the U.S. president rejected the call outright.
This page tracks what was actually proposed, who said what on which date, and which parts of the argument are checkable. The debate is moving fast; every claim below carries the date it was made.
What happened, in order
| Date | Event | Source basis |
|---|---|---|
| March 2023 | Future of Life Institute open letter calls for a pause of at least six months on training systems more powerful than GPT-4; signed by researchers and technologists including Yoshua Bengio and Steve Wozniak | Public letter, widely reported |
| May 2023 | Geoffrey Hinton publicly states concern about AI development risks after leaving Google | Public statements, widely reported |
| June 2026 | Anthropic is reported to have called for major labs to consider a "coordinated and verifiable pause," citing rapid growth in autonomous task capability | Reuters reporting, June 2026 |
| Late July 2026 | More than 1,200 employees and researchers at OpenAI, Anthropic, Google, Microsoft, and Meta sign a public statement urging the U.S. government to pursue international coordination | Axios reporting, July 30, 2026 |
| September 12, 2026 | Anthropic CEO Dario Amodei publishes "We Must Pace the Frontier," a three-part plan; Anthropic unilaterally commits to the first part | Essay and author's public post |
| September 12–13, 2026 | Sam Altman, Demis Hassabis, Elon Musk, and Satya Nadella publicly express support for coordinating the frontier pace | Public posts and remarks |
| September 13, 2026 | U.S. President Donald Trump, speaking in Ireland, rejects slowing development, saying the U.S. is ahead on AI and "whoever wins AI wins" | Press remarks |
| September 14, 2026 | AI-related equities fall across Asian markets; SoftBank reported down as much as 13.2%, with SK Hynix, Samsung Electronics, and Tokyo Electron also declining | Market reporting |
| September 15, 2026 | Nvidia CEO Jensen Huang rejects the premise at Dreamforce, calling safety an engineering problem rather than a legal one; Mark Zuckerberg argues each lab should set its own pace but is more open to third-party oversight | Public remarks |
The three-part proposal, and what each part costs
Amodei's plan is more specific than previous pause proposals, which is why it moved markets. In outline:
- Embedded third-party evaluators. External teams receive permanent, employee-level access to frontier AI companies so they can verify safety measures, report incidents, and assess alignment during training. Anthropic states it is unilaterally committing to this step.
- Common standards among frontier labs in democratic countries, including agreed limits on how fast capability is advanced.
- International coordination extending the arrangement beyond one bloc of countries.
The first part is the only one with a stated unilateral commitment, and it is also the only part whose cost can be bounded with public numbers. That makes it a useful test case for the wider argument.
What pacing would actually cost, in tokens
Frontier training runs are expensive, but the scale is hard to feel. One way to make it concrete is to convert a training budget into the equivalent volume of API tokens at published rates.
Public estimates put the cost of training a 2026 frontier-tier model in the range of $500 million to $1.5 billion. These are estimates synthesized from cluster size, hardware analysis, and disclosed figures; no lab publishes its actual training cost, and estimates vary by source. Taking the low end of $500 million and pricing it against published API input rates:
| Reference rate | Published price | Equivalent input tokens for $500M |
|---|---|---|
| GPT-5.6 Luna | $0.20 per 1M input tokens | 2.5 quadrillion input tokens |
| Claude Sonnet 5 | $2.00 per 1M input tokens | 250 trillion input tokens |
| DeepSeek V4.1 Flash | $0.15 per 1M input tokens | 3.33 quadrillion input tokens |
Those conversions are arithmetic on published unit rates, not measurements of anything. They are useful for one reason: they show that a single training run is worth more tokens than most organizations will consume in a decade. You can reproduce any of them with the AI API cost calculator, and estimate your own text volume with the token counter.
Now compare that with the price of the proposed safeguard. A permanent embedded evaluation team is a staffing cost. Even at a generous assumption of 20 to 40 senior researchers at a fully loaded $400,000 to $700,000 per person per year, the annual bill lands between $8 million and $28 million. Against a $500 million training run, that is roughly 1.6% to 5.6% of the cost of one model generation.
This is an AI Agent Hub estimate, not a disclosed figure. It assumes fully loaded compensation in the range above and excludes the cost of compute set aside for evaluation work. The point stands regardless of the exact number: the most concrete safeguard on the table is cheap relative to the thing it is meant to restrain. That asymmetry is the strongest argument available to supporters of pacing, and it is notable that it is rarely stated numerically.
What is checkable and what is a judgment
The debate mixes verifiable claims with forecasts. Sorting them changes how strong each side looks.
| Claim | Type | Status as of September 18, 2026 |
|---|---|---|
| Anthropic committed to giving third-party evaluators permanent employee-level access | Company commitment | Publicly stated; independent verification of implementation not yet available |
| AI systems increasingly help build the next generation of AI | Operational claim | Asserted by lab leadership; consistent with published tool-use and coding-agent adoption, but not independently measured in public |
| An incident occurred in which AI agents conducted unauthorized cyber activity and attempted to interfere with their evaluation | Incident claim | Referenced in Amodei's essay; primary technical report not independently reviewed by this site |
| A slowdown of one to two years would materially reduce the chance of a serious failure | Judgment | Not verifiable; depends on unverified assumptions about capability trajectories |
| Slowing down would let another country overtake the U.S. in AI | Judgment | Contested; no public measurement of relative frontier capability with agreed methodology |
| Market reaction on September 14, 2026 was severe | Market fact | Reported; SoftBank down as much as 13.2% in a single session |
Only the last row is a fact that can be checked against a public tape without interpretation. That is not a criticism of either side; it is a reminder that most of this argument lives in the judgment column, and readers should weigh it accordingly.
The opposition is not one position
Reports often collapse the critics into "the other side," but the objections are different and some are compatible with parts of the proposal.
- Jensen Huang (Nvidia) argues safety is an engineering problem rather than a legal one, and that the supposed trade-off between innovation, speed, and safety is a false trilemma. He opposes new antitrust exemptions or dedicated legislation to coordinate a slowdown, arguing market accountability and customer trust already supply the incentive.
- Mark Zuckerberg (Meta) says each lab should set pace according to its own model's safety needs, and that competition, liability, and infringement risk already provide safety incentives. He is reported to be more open than Huang to third-party oversight.
- David Sacks objects to suspending antitrust law or replacing existing product liability with an approval regime, and has questioned the independence of proposed external evaluation bodies.
- Donald Trump rejects slowing down on competitiveness grounds, framing AI as a race with China and attributing warnings to unnamed "negative forces."
- Chinese Foreign Ministry spokesperson Guo Jiakun characterized the calls as fearmongering from a Cold War playbook, saying confrontation and malicious competition disrupt global AI governance.
Note that several of these objections are about mechanism rather than risk. Arguing that market liability is sufficient is different from arguing that the risk is fictional, and the distinction gets lost in coverage.
What is actually being negotiated
Stripped of the safety language, four questions are on the table: who decides how capable a system may become, who captures the returns, who bears the cost of a failure, and who is accountable afterward. Those decisions are currently made inside private companies, while the consequences land on people who have no say in them.
Two historical analogues are commonly raised. The 1975 Asilomar conference on recombinant DNA produced tiered containment rules whose force came from federal funding conditions rather than from the risk itself; today, the detailed knowledge sits with private firms rather than grantees, which is precisely why embedded evaluators are proposed. The history of nuclear energy offers a second model, where international safeguards were attached to a technology with obvious state interest. Both analogies are imperfect, and neither answers the timing question.
What would settle the argument
The debate is short on public measurements that could actually resolve it. Three would help more than another essay:
- A published, third-party-audited evaluation protocol with defined thresholds, so that "safe enough to ship" means something measurable rather than a matter of internal judgment.
- An agreed methodology for measuring frontier capability over time, so that claims about acceleration, and about who is ahead, can be checked instead of asserted.
- Standardized incident reporting, so that the cyber-activity incident referenced in the proposal becomes a documented case study with a primary source rather than an anecdote in an essay.
Until those exist, the productive reading is narrow: one lab has committed to external evaluation access, several leaders agree in general terms that coordination is desirable, and no binding mechanism or schedule exists. Everything else is a position, not a fact.
Frequently asked questions
Is "pacing the frontier" the same as pausing AI development?
No. The September 12, 2026 essay states that pacing does not mean stopping, but slowing enough for alignment, interpretability, testing, and operational safeguards to keep pace with capability.
Has any company actually committed to slowing down?
As of September 18, 2026 the only unilateral commitment reported is Anthropic's pledge of permanent, employee-level evaluator access. No published release schedule limits have been announced by any lab, and no binding multi-lab agreement exists.
Why did AI stocks fall?
On September 14, 2026 AI-related equities fell sharply across Asian markets following the public calls for a slower pace, with SoftBank reported down as much as 13.2% and chipmakers including SK Hynix, Samsung Electronics, and Tokyo Electron also declining. The move reflects uncertainty about whether slower development affects planned infrastructure investment.
Is recursive self-improvement happening now?
Lab leadership asserts that AI systems increasingly assist in building the next generation of AI. Publicly verifiable evidence of a closed loop in which models autonomously improve themselves without human direction has not been published.
Does slowing down require new laws?
The first two parts of the proposal can be adopted by companies without legislation. Cross-lab binding limits and international coordination would require government action, which is the contested part.
Primary sources and further reading
- Anthropic — "We Must Pace the Frontier" (September 12, 2026)
- Digital Watch Observatory — AI companies and US government disagree on slowing down (September 2026)
- TechRadar — reactions from Huang, Zuckerberg, and Beijing (September 2026)
- AI Incident Database — public catalogue of AI harms and near-misses
- AI Debate & Evidence — all topics on this site
Bottom line
The September 2026 shift is real and unusually broad: several frontier lab leaders now say capability should advance more slowly than it currently does. What exists in public is one unilateral commitment to external evaluator access, general expressions of support, and no binding mechanism. The safeguard being proposed costs low single-digit percentages of a single training run, while the claims used to justify urgency sit mostly in the judgment column. Treat the commitments as checkable and the forecasts as forecasts.