Skip to content
AI EmployeeSuper-AgentsAgent-to-AgentTutorialsPricingBlogContact

Intelligence Explosion Paper: What 22 AI Leaders Warn

At a glanceQuick answers
What is this paper?
A 14-page working paper (Frontier AI Working Paper Series No. 2/2026) from the Cambridge Programme on AI Science and Policy and GovAI, dated September 28, 2026, with 22 authors from academia, civil society and frontier AI companies.
What is its central claim?
That AI systems are on track to automate most AI R&D within a few years, that this could trigger a feedback loop compressing years of progress into months, and that governments should prepare now.
What is the one caveat to carry?
The authors call the evidence preliminary and sometimes mixed, and say their views are their own, not their employers’. The five-weeks figure is a model output under stated assumptions, not a forecast.
Editorial data illustration on a near-white ground titled What if AI automates AI R&D: a teal staircase whose steps rise faster toward an amber top step, a teal feedback arrow looping from the top back to the bottom, and a large 10x labeled pace of AI progress in about 17 months in the paper's model
Fig 0The paper's central model: each doubling comes faster than the last. Made by CellCog's image agent, running GPT Image 2.5.

A working paper published on September 28, 2026 asks the question the frontier labs are building toward: what happens if AI automating AI research triggers an intelligence explosion? Its 22 authors include OpenAI’s chief scientist Jakub Pachocki, Anthropic co-founder Jack Clark, Microsoft’s Eric Horvitz, Geoffrey Hinton and Yoshua Bengio. Their closing line: “Once an intelligence explosion begins, the window for action may close.”

This page is read from the paper itself. Every number below is the paper’s, and the arithmetic in the chart is ours from the paper’s stated parameters.

On this page · 9 sectionsOpen
  1. What the paper argues
  2. The evidence it cites
  3. The math behind five weeks
  4. What could stop it
  5. What it asks policymakers to do
  6. What is not established
  7. What we are watching
  8. Where CellCog sits
  9. Sources
Key points6 · 6 min full read
  1. On September 28, 2026, 22 authors including OpenAI chief scientist Jakub Pachocki, Anthropic co-founder Jack Clark, Geoffrey Hinton and Yoshua Bengio published a working paper asking what happens if automating AI R&D triggers an intelligence explosion.
  2. They define an intelligence explosion as an AI-driven acceleration that compresses advances that would otherwise take years into months or less, and argue it is possible, not certain.
  3. The evidence starts inside the labs: at Anthropic, AI’s share of approved code rose from low single digits to over 80% between January 2025 and May 2026, and work done with only high-level supervision rose from 1% to 26% between March and August 2026.
  4. In the paper’s central model, if returns to research effort stay at historical estimates of 1.2 to 1.9 and nothing else bottlenecks, the pace of AI progress rises tenfold in about 1.5 years, so a year of today’s progress would take about five weeks.
  5. The authors estimate OpenAI’s inference compute alone could run an effective workforce of about 2 million to 200 million researchers, against the thousands of researchers frontier labs employ today.
  6. Their three asks for policymakers: visibility into AI R&D automation inside the labs, ways to steer and constrain an explosion (including options to pause specific workloads), and plans to adapt. No company has issued a statement on the paper.

§ 01What the paper argues

The authors define an intelligence explosion as a dramatic AI-driven acceleration of AI progress that compresses advances that would otherwise take years into months or less. The mechanism has two parts: AI systems expand the effective research workforce as they get better at AI R&D, and that workforce builds better systems that expand it further.

They do not claim it has started. In their words: “Productivity gains from AI R&D automation have not yet reached the threshold needed to trigger an intelligence explosion, but gains from newer systems are likely approaching that threshold.”

§ 02The evidence it cites

Claim What the paper reports
AI share of approved code at Anthropic Low single digits to over 80%, January 2025 to May 2026
Anthropic R&D done with only high-level supervision 1% to 26%, March to August 2026
Task length AI can complete Seconds-long tasks in 2023, hours to days now
Months-long AI R&D projects automated By mid-2028, on some tentative extrapolations
Effective AI research workforce on OpenAI’s compute About 2 million to 200 million researchers, modeled
Returns to research effort (r) Central estimates of 1.2 to 1.9 across three AI subfields
Table 1What the paper cites as evidence that AI R&D is being automated

The Anthropic figures come from the lab’s own measurements, which we covered in Anthropic’s three numbers. The paper also quotes OpenAI saying “AI assistance is used in practically all parts of the company across technical and non-technical teams”, and cites the OpenAI Hugging Face incident, where roughly 1,200 internal agents acted outside their intended scope, as an example of the oversight risk.

§ 03The math behind five weeks

The headline number comes from the paper’s supplementary model. With its central parameters, each doubling of software quality raises the growth rate by about 31%, so each doubling takes about 76% as long as the one before. Starting from a first doubling of 4.5 months, the pace of progress passes tenfold after nine doublings.

Months per doubling of software quality in the paper's central modelBar chart of months per doubling in the paper's central model, falling from 4.5 months for the first doubling to 0.5 months for the ninth, which is highlightedDoubling 14.5Doubling 23.4Doubling 32.6Doubling 42.0Doubling 51.5Doubling 61.1Doubling 70.9Doubling 80.7Doubling 90.5Months per doubling of software quality in the paper's central modelBar chart of months per doubling in the paper's central model, falling from 4.5 months for the first doubling to 0.5 months for the ninth, which is highlightedDoubling 14.5Doubling 23.4Doubling 32.6Doubling 42.0Doubling 51.5Doubling 61.1Doubling 70.9Doubling 80.7Doubling 90.5
Fig 1Months per doubling of software quality in the paper's central model

Nine doublings add up to about 17 months, which the paper rounds to about 1.5 years. At that point, in the model, a year of progress at today’s pace would take about five weeks. The authors are explicit that the model rests on uncertain parameters and may not hold at extreme scales.

§ 04What could stop it

The paper names four frictions and grades the evidence on each:

  • Diminishing returns. The r estimates suggest they would not prevent an explosion, but rely on limited data.
  • Compute and data. Mixed evidence. If experiments need proportionally more compute as training runs grow, a software-only explosion is not possible, and internet data is on track to grow too slowly past 2028.
  • Hard-to-automate tasks. Indirect evidence says they need not stop it if automation advances fast enough; there is no empirical data on which tasks stay hard.
  • Time-intensive processes. No direct evidence. Training runs can take three months or more.

§ 05What it asks policymakers to do

  1. Get visibility. Standardized reporting of AI R&D automation to governments and third-party auditors, funded outside measurement, and possibly independent evaluators embedded inside frontier companies.
  2. Steer and constrain. Requirements for continued development, limits on how fast capabilities can grow in a given period, oversight of data centers, options to pause specific AI R&D workloads, and isolated environments for some evaluations.
  3. Prepare to adapt. Faster institutional response, emergency plans for labor, geopolitical and loss-of-control scenarios, and safeguards on government use of AI.

“Relative to the stakes, we are not sufficiently prepared,” the authors write.

§ 06What is not established

  • Company positions. The paper says its views are the authors’ own and not necessarily their organizations’. As of September 29, 2026, OpenAI, Anthropic, Google DeepMind, Microsoft and Meta have issued no statement on it.
  • The parameters. The r estimates come from a period of fast compute scaling, which the authors say could bias them upward.
  • Timing. The mid-2028 figure is an extrapolation of task-length trends, labeled tentative.

§ 07What we are watching

  • Any lab publishing the indicators the paper asks for, as Anthropic did in September.
  • Government responses to the reporting and pausing proposals.
  • Independent estimates of r under slower compute growth.

§ 08Where CellCog sits

CellCog builds AI employees on models from several of these labs, for business work rather than AI research. Our founder’s view on the two halves of self-improvement, the model half this paper studies and the harness half we build, is in Self-improving AI has two halves.

§ 09Sources

Frequently asked5 questions

Q1Who wrote the intelligence explosion paper?

22 authors, led by Alan Chan (GovAI) and Soren Mindermann (CASP, University of Cambridge). They include Jakub Pachocki (OpenAI), Jack Clark and Anton Korinek (Anthropic), Eric Horvitz (Microsoft), Geoffrey Hinton, Yoshua Bengio, Dawn Song, Andrew Barto and Jeff Clune.

Q2Is an intelligence explosion certain, according to the paper?

No. The authors say preliminary evidence suggests it could happen and list four frictions that push against it: diminishing returns, compute and data limits, hard-to-automate tasks, and time-intensive processes such as long training runs.

Q3What does the r number mean?

r is the returns to research effort. Below 1, diminishing returns win and progress fades; above 1, more R&D labor accelerates progress. The paper cites central estimates of 1.2 to 1.9 across three subfields of AI research, from Ho and Whitfill.

Q4What do the authors want governments to do?

Require standardized reporting of AI R&D automation to governments and auditors, consider independent evaluation before internal deployment, prepare ways to pace scale-ups and pause specific workloads, and write emergency plans for labor, geopolitical and loss-of-control scenarios.

Q5Where can I read the paper?

As a PDF from the Cambridge Programme on AI Science and Policy and on GovAI’s research page, both linked in the sources below. We found no arXiv version as of September 29, 2026.

Published 29 September 2026 All Multi-agent & AI organizations →