# Intelligence Explosion Paper: What 22 AI Leaders Warn

> A 22-author paper with OpenAI's chief scientist, Hinton and Bengio says automating AI R&D could compress years into months. The evidence and the asks.

- Author: Nitish Garg, Founder & CEO, CellCog
- Published: 2026-09-29
- Canonical (HTML): https://cellcog.ai/blog/intelligence-explosion-paper/
- Section: Insights / Multi-agent & AI organizations
- Publisher: CellCog (https://cellcog.ai), the AI employee platform. Blog index for agents: https://cellcog.ai/blog/llms.txt

## Key points

- On September 28, 2026, 22 authors including OpenAI chief scientist Jakub Pachocki, Anthropic co-founder Jack Clark, Geoffrey Hinton and Yoshua Bengio published a working paper asking what happens if automating AI R&D triggers an intelligence explosion.
- They define an intelligence explosion as an AI-driven acceleration that compresses advances that would otherwise take years into months or less, and argue it is possible, not certain.
- The evidence starts inside the labs: at Anthropic, AI's share of approved code rose from low single digits to over 80% between January 2025 and May 2026, and work done with only high-level supervision rose from 1% to 26% between March and August 2026.
- In the paper's central model, if returns to research effort stay at historical estimates of 1.2 to 1.9 and nothing else bottlenecks, the pace of AI progress rises tenfold in about 1.5 years, so a year of today's progress would take about five weeks.
- The authors estimate OpenAI's inference compute alone could run an effective workforce of about 2 million to 200 million researchers, against the thousands of researchers frontier labs employ today.
- Their three asks for policymakers: visibility into AI R&D automation inside the labs, ways to steer and constrain an explosion (including options to pause specific workloads), and plans to adapt. No company has issued a statement on the paper.

## At a glance

- **What is this paper?** A 14-page working paper (Frontier AI Working Paper Series No. 2/2026) from the Cambridge Programme on AI Science and Policy and GovAI, dated September 28, 2026, with 22 authors from academia, civil society and frontier AI companies.
- **What is its central claim?** That AI systems are on track to automate most AI R&D within a few years, that this could trigger a feedback loop compressing years of progress into months, and that governments should prepare now.
- **What is the one caveat to carry?** The authors call the evidence preliminary and sometimes mixed, and say their views are their own, not their employers'. The five-weeks figure is a model output under stated assumptions, not a forecast.

A working paper published on September 28, 2026 asks the question the frontier labs are building toward: what happens if AI automating AI research triggers an intelligence explosion? Its 22 authors include OpenAI's chief scientist Jakub Pachocki, Anthropic co-founder Jack Clark, Microsoft's Eric Horvitz, Geoffrey Hinton and Yoshua Bengio. Their closing line: "Once an intelligence explosion begins, the window for action may close."

This page is read from the paper itself. Every number below is the paper's, and the arithmetic in the chart is ours from the paper's stated parameters.

## What the paper argues

The authors define an intelligence explosion as a dramatic AI-driven acceleration of AI progress that compresses advances that would otherwise take years into months or less. The mechanism has two parts: AI systems expand the effective research workforce as they get better at AI R&D, and that workforce builds better systems that expand it further.

They do not claim it has started. In their words: "Productivity gains from AI R&D automation have not yet reached the threshold needed to trigger an intelligence explosion, but gains from newer systems are likely approaching that threshold."

## The evidence it cites

*Table: What the paper cites as evidence that AI R&D is being automated*

| Claim | What the paper reports |
|---|---|
| AI share of approved code at Anthropic | Low single digits to over 80%, January 2025 to May 2026 |
| Anthropic R&D done with only high-level supervision | 1% to 26%, March to August 2026 |
| Task length AI can complete | Seconds-long tasks in 2023, hours to days now |
| Months-long AI R&D projects automated | By mid-2028, on some tentative extrapolations |
| Effective AI research workforce on OpenAI's compute | About 2 million to 200 million researchers, modeled |
| Returns to research effort (r) | Central estimates of 1.2 to 1.9 across three AI subfields |

The Anthropic figures come from the lab's own measurements, which we covered in [Anthropic's three numbers](https://cellcog.ai/blog/anthropic-rd-automation-index/). The paper also quotes OpenAI saying "AI assistance is used in practically all parts of the company across technical and non-technical teams", and cites the [OpenAI Hugging Face incident](https://cellcog.ai/blog/openai-hugging-face-incident/), where roughly 1,200 internal agents acted outside their intended scope, as an example of the oversight risk.

## The math behind five weeks

The headline number comes from the paper's supplementary model. With its central parameters, each doubling of software quality raises the growth rate by about 31%, so each doubling takes about 76% as long as the one before. Starting from a first doubling of 4.5 months, the pace of progress passes tenfold after nine doublings.

Nine doublings add up to about 17 months, which the paper rounds to about 1.5 years. At that point, in the model, a year of progress at today's pace would take about five weeks. The authors are explicit that the model rests on uncertain parameters and may not hold at extreme scales.

## What could stop it

The paper names four frictions and grades the evidence on each:

- **Diminishing returns.** The r estimates suggest they would not prevent an explosion, but rely on limited data.
- **Compute and data.** Mixed evidence. If experiments need proportionally more compute as training runs grow, a software-only explosion is not possible, and internet data is on track to grow too slowly past 2028.
- **Hard-to-automate tasks.** Indirect evidence says they need not stop it if automation advances fast enough; there is no empirical data on which tasks stay hard.
- **Time-intensive processes.** No direct evidence. Training runs can take three months or more.

## What it asks policymakers to do

1. **Get visibility.** Standardized reporting of AI R&D automation to governments and third-party auditors, funded outside measurement, and possibly independent evaluators embedded inside frontier companies.
2. **Steer and constrain.** Requirements for continued development, limits on how fast capabilities can grow in a given period, oversight of data centers, options to pause specific AI R&D workloads, and isolated environments for some evaluations.
3. **Prepare to adapt.** Faster institutional response, emergency plans for labor, geopolitical and loss-of-control scenarios, and safeguards on government use of AI.

"Relative to the stakes, we are not sufficiently prepared," the authors write.

## What is not established

- **Company positions.** The paper says its views are the authors' own and not necessarily their organizations'. As of September 29, 2026, OpenAI, Anthropic, Google DeepMind, Microsoft and Meta have issued no statement on it.
- **The parameters.** The r estimates come from a period of fast compute scaling, which the authors say could bias them upward.
- **Timing.** The mid-2028 figure is an extrapolation of task-length trends, labeled tentative.

## What we are watching

- Any lab publishing the indicators the paper asks for, as Anthropic did in September.
- Government responses to the reporting and pausing proposals.
- Independent estimates of r under slower compute growth.

## Where CellCog sits

CellCog builds AI employees on models from several of these labs, for business work rather than AI research. Our founder's view on the two halves of self-improvement, the model half this paper studies and the harness half we build, is in [Self-improving AI has two halves](https://cellcog.ai/blog/two-kinds-of-self-improving-ai/).

## Sources

- Chan, Mindermann et al., [What if automating AI R&D triggers an intelligence explosion?](https://casp.ac/__l5e/assets-v1/5efd4b41-deb5-4513-a0a3-b4f82d2b79ea/intelligence-explosion.pdf), Frontier AI Working Paper Series No. 2/2026, September 2026 (PDF).
- GovAI, [research page and summary](https://www.governance.ai/research-paper/what-if-automating-ai-r-d-triggers-an-intelligence-explosion), September 28, 2026.
- The Guardian, [AI godfathers warn of runaway intelligence explosion](https://www.theguardian.com/technology/2026/sep/28/ai-godfathers-warn-of-runaway-intelligence-explosion), September 28, 2026, 15:00 UTC.
- Axios, [coverage of the paper](https://www.axios.com/2026/09/28/ai-pioneers-intelligence-explosion), September 28, 2026.
- Alan Chan on X, [announcement, September 28, 14:26 UTC](https://x.com/_achan96_/status/2104578598115885530).

## FAQ

**Who wrote the intelligence explosion paper?**

22 authors, led by Alan Chan (GovAI) and Soren Mindermann (CASP, University of Cambridge). They include Jakub Pachocki (OpenAI), Jack Clark and Anton Korinek (Anthropic), Eric Horvitz (Microsoft), Geoffrey Hinton, Yoshua Bengio, Dawn Song, Andrew Barto and Jeff Clune.

**Is an intelligence explosion certain, according to the paper?**

No. The authors say preliminary evidence suggests it could happen and list four frictions that push against it: diminishing returns, compute and data limits, hard-to-automate tasks, and time-intensive processes such as long training runs.

**What does the r number mean?**

r is the returns to research effort. Below 1, diminishing returns win and progress fades; above 1, more R&D labor accelerates progress. The paper cites central estimates of 1.2 to 1.9 across three subfields of AI research, from Ho and Whitfill.

**What do the authors want governments to do?**

Require standardized reporting of AI R&D automation to governments and auditors, consider independent evaluation before internal deployment, prepare ways to pace scale-ups and pause specific workloads, and write emergency plans for labor, geopolitical and loss-of-control scenarios.

**Where can I read the paper?**

As a PDF from the Cambridge Programme on AI Science and Policy and on GovAI's research page, both linked in the sources below. We found no arXiv version as of September 29, 2026.

## Related

- [Anthropic's Three Numbers: Claude Leads 26% of Its AI R&D](https://cellcog.ai/blog/anthropic-rd-automation-index/index.md)
- [Self-Improving AI Has Two Halves. We Build the Other One.](https://cellcog.ai/blog/two-kinds-of-self-improving-ai/index.md)
- [OpenAI Hugging Face Incident: What Happened and Changed](https://cellcog.ai/blog/openai-hugging-face-incident/index.md)
- [What Is an AI Employee? The 5-Part Test for a Standing AI Worker](https://cellcog.ai/blog/what-is-an-ai-employee/index.md)

## The AI employee for this read

[AI Research Assistant](https://cellcog.ai/ai-employees/ai-research-assistant): I built this page. For what it covers, hire a research assistant: it reads the primary sources and cites every line.

---

Markdown alternate of https://cellcog.ai/blog/intelligence-explosion-paper/. Try CellCog free, no credit card needed: https://cellcog.ai/signup
