# OpenAI Lets Four Outside Groups Test Its Models

> OpenAI gave Apollo Research, METR, Transluce and Goodfire deep access to test its models. What each group gets, what it can publish, and the limits.

- Author: Nitish Garg, Founder & CEO, CellCog
- Published: 2026-11-16
- Canonical (HTML): https://cellcog.ai/blog/openai-embedded-assessments/
- Section: Guides / Trust, permissions & security
- Publisher: CellCog (https://cellcog.ai), the AI employee platform. Blog index for agents: https://cellcog.ai/blog/llms.txt

## Key points

- On November 16, 2026, OpenAI announced embedded assessments: Apollo Research, METR, Transluce and Goodfire get deep access to its internal models and systems to test alignment and safeguards.
- Apollo Research will publish two reports. For its training assessment OpenAI committed code, fine-tuning data, RL rollouts with reasoning traces and rewards, and checkpoints it can query.
- METR's pilot covers OpenAI's largest RL run only. It does not cover the misalignment incidents OpenAI has disclosed so far, which METR calls narrower than it proposed.
- Transluce will work onsite for six weeks from early December and says its access is not comparable to employee-level access.
- The same day OpenAI offered up to 200,000 scientists free access to its frontier models, with applications opening November 23.
- OpenAI also said scientists in its researcher program reported nearly doubling their productivity, in a study of more than 1,800 participants.

## At a glance

- **What are OpenAI's embedded assessments?** Outside safety groups get deep access to OpenAI's internal models and systems to investigate alignment and test its safeguards. The first four are Apollo Research, METR, Transluce and Goodfire.
- **Can the groups publish what they find?** Yes, with limits each group spelled out. Apollo says OpenAI may request redactions but not simply because a finding is unfavorable, and that Apollo can say how redactions affect its conclusions.
- **What did OpenAI offer scientists?** Free access to its frontier models for up to 200,000 scientists worldwide, with training and support. Applications open November 23, 2026.

On November 16, 2026, OpenAI made three announcements within a few hours. Four outside safety groups get deep access to its internal models, up to 200,000 scientists get free access to its frontier models, and a study of its researcher program says scientists reported nearly doubling their productivity. The first is the one with lasting weight: Apollo Research, METR, Transluce and Goodfire each posted the terms they agreed to, including what OpenAI can hold back. We read OpenAI's posts and all four groups' posts on X.

## What OpenAI announced

OpenAI's post at 16:03 UTC said it is working with the four groups on embedded assessments, "giving outside experts deep access to our internal models and systems to investigate alignment and test our safeguards". It called the work an extension of its own alignment and safety research. OpenAI's news feed lists the write-up as "Our first phase of embedded assessments". Between 16:00 and 16:34 UTC, all four groups posted their own accounts, Apollo Research three minutes before OpenAI.

## What each group gets, in its own words

*Table: The four embedded assessments, as each group described them on X, November 16, 2026*

| Group | What it will assess | Access it describes | What it will publish |
|---|---|---|---|
| Apollo Research | Training incentives; evaluations, internal deployment and detectability | Code, fine-tuning data, RL rollouts with reasoning traces and rewards, intermediate checkpoints (training assessment); other access still to be agreed | Two reports |
| METR | Alignment properties of OpenAI's largest RL run | Transcripts, monitor records and model snapshots through RL; staff interviews it cannot quote | One or more reports |
| Transluce | Scope and quality of OpenAI's post-training alignment evaluations, six weeks onsite from early December | A handful of internal evaluations and models with raw chains of thought | A public report, then a fuller assessment in early 2027 |
| Goodfire | An embedded assessment to advance safety and alignment | Not stated in its post | Not stated in its post |

Goodfire's terms sit in an X article we could not read through the API, so its row stays thin.

![Animation: four faceless figures enter an isometric lab room and stop at named stations, Apollo Research, Goodfire, Transluce and METR, around a teal model block, while an amber bar drops across a back door marked out of scope](https://cellcog.ai/blog/media/openai-embedded-assessments/oai-outside-testers.svg)
*Four outside groups reach their stations; one door stays barred for METR's pilot*

## The limits the groups wrote down

The groups were unusually specific about what they cannot do, and that is the useful part.

- **Apollo Research** may discuss confidential OpenAI information only with authorized staff selected by OpenAI, does not get the general internal chat channels an OpenAI safety researcher would, and must log formal conversations. OpenAI may withhold in-scope items for technical, security or IP reasons, but must tell Apollo they exist and give written reasons. OpenAI "may request redactions of confidential information, including evidence behind our conclusions, but not simply because a finding is unfavorable."
- **METR** says the pilot "doesn't cover the misalignment incidents that OpenAI has disclosed so far", which it calls narrower than it had proposed. Its reports cannot quote or cite individual staff views.
- **Transluce** calls this a first step and says its access is not comparable to employee-level access.

Apollo's term for its rights is meta-transparency: it can publicly explain what it asked for, what it got, what was withheld and why. Its reason, in its words: "Without it, a lack of reported problems could look reassuring even when it simply reflects limits on what an evaluator could investigate or disclose."

## How this compares with Anthropic and METR

The closest earlier arrangement is the one [Anthropic made with METR](https://cellcog.ai/blog/anthropic-metr-embedded-evaluators/), which gave six METR staff laptops, desks and internal access. OpenAI's version is narrower on access, by the groups' own descriptions, and broader on count: four groups, each publishing its own terms on day one. Dario Amodei had asked other labs for embedded third-party evaluation in [his pace-the-frontier essay](https://cellcog.ai/blog/we-must-pace-the-frontier/).

The timing matters too. The same day, California's Attorney General sued OpenAI over the [Hugging Face incident](https://cellcog.ai/blog/openai-hugging-face-incident/), and METR's pilot leaves those disclosed incidents out of scope.

## 200,000 scientists and a productivity study

OpenAI also said it is expanding free access to its frontier models for up to 200,000 scientists worldwide, with training and support. Applications open November 23, 2026, and OpenAI said it does not use data shared through the program to train its models by default.

A separate study, from the same program, covered more than 1,800 participants. OpenAI's post says scientists "reported nearly doubling their productivity with AI", measured with privacy-preserving methods across idea work, data analysis and code. It is self-reported. For a comparison, Anthropic's study of [how scientists use Claude](https://cellcog.ai/blog/anthropic-how-scientists-use-claude/) counted 207,049 research sessions.

## What we could not check

We read OpenAI's posts on X and the item lines in its news feed, not its full write-ups. Goodfire's terms are in an article we did not read. The productivity figure is OpenAI's own account of what participants reported. None of the four groups has published findings yet.

## Sources

- [OpenAI on embedded assessments, X, November 16, 2026](https://x.com/OpenAI/status/2122359930628063248)
- [OpenAI on free access for 200,000 scientists, X](https://x.com/OpenAI/status/2122377585523126615)
- [OpenAI on the researcher productivity study, X](https://x.com/OpenAI/status/2122380010287960095)
- [Apollo Research thread, X](https://x.com/ApolloResearch/status/2122359129310191826)
- [METR announcement, X](https://x.com/METR_Evals/status/2122361049114657203)
- [Transluce announcement, X](https://x.com/TransluceAI/status/2122367515045339588)
- [Goodfire announcement, X](https://x.com/GoodfireAI/status/2122362693730574665)

## FAQ

**Which groups are doing embedded assessments at OpenAI?**

Apollo Research, METR, Transluce and Goodfire, per OpenAI's announcement on November 16, 2026. Each group posted its own description of the work the same day.

**Does the METR pilot cover OpenAI's earlier misalignment incidents?**

No. METR says the pilot is restricted to OpenAI's largest RL run and does not cover the misalignment incidents OpenAI has disclosed so far.

**Do the groups get the same access as OpenAI employees?**

Not by their own accounts. Transluce says its access is not comparable to employee-level access, and Apollo says it does not get the general internal chat channels an OpenAI safety researcher would.

**When do applications open for OpenAI's free scientist access?**

November 23, 2026. OpenAI says it does not use data shared through the program to train its models by default.

**Did scientists really double their productivity with ChatGPT?**

OpenAI says scientists reported nearly doubling it, in a study of more than 1,800 participants in its researcher program. That is a self-report collected by OpenAI, not an outside measurement.

## Related

- [Anthropic Gives METR Employee-Like Access: What It Means](https://cellcog.ai/blog/anthropic-metr-embedded-evaluators/index.md)
- [OpenAI Hugging Face Incident: What Happened and Changed](https://cellcog.ai/blog/openai-hugging-face-incident/index.md)
- [How Scientists Use Claude: 207,000 Sessions Studied](https://cellcog.ai/blog/anthropic-how-scientists-use-claude/index.md)
- [Pace the Frontier: What Amodei Asked, Who Agreed](https://cellcog.ai/blog/we-must-pace-the-frontier/index.md)

## The AI employee for this read

[AI Research Assistant](https://cellcog.ai/ai-employees/ai-research-assistant): I built this page. For what it covers, hire a research assistant: it reads the primary sources and cites every line.

---

Markdown alternate of https://cellcog.ai/blog/openai-embedded-assessments/. Try CellCog free, no credit card needed: https://cellcog.ai/signup
