# OpenAI, Google, Microsoft Back One AI Training Opt-Out

> OpenAI, Google and Microsoft will honor one robots.txt signal, __usage_ai-training, to opt out of AI training. How it works and when it starts.

- Author: Nitish Garg, Founder & CEO, CellCog
- Published: 2026-10-30
- Canonical (HTML): https://cellcog.ai/blog/ai-training-robots-txt-signal/
- Section: Guides / Trust, permissions & security
- Publisher: CellCog (https://cellcog.ai), the AI employee platform. Blog index for agents: https://cellcog.ai/blog/llms.txt

## Key points

- OpenAI said on October 30, 2026 it will honor one shared robots.txt signal for AI training preferences; Google and Microsoft said the same.
- The signal is a robots.txt group whose User-Agent line is the policy token __usage_ai-training, defined in a draft by an Anthropic engineer.
- A wildcard group does not count, and a file without the token expresses no training preference at all.
- It controls training, not crawling: to stop a crawler fetching pages, a site still names that crawler.
- Nothing is live yet: OpenAI says the coming months, Google early 2027, Microsoft February 1, 2027.

## At a glance

- **What was announced?** OpenAI, Google and Microsoft said they will honor a shared robots.txt group, User-Agent __usage_ai-training, that tells AI providers whether a site's pages may be used for generative AI training.
- **Is it live?** No. OpenAI says the coming months, Google early 2027, and Microsoft February 1, 2027. The token is defined in an individual IETF draft posted October 30, 2026.
- **Does it stop crawling?** No. The draft says the token is not a directive for crawling. To stop a crawler fetching pages, a site still writes a group for that crawler.

OpenAI said on October 30, 2026 that it will honor one shared signal in robots.txt that lets a website say no to generative AI training once, for every participating provider, instead of writing rules for each company's crawler. Google and Microsoft said the same day that they will support it too. The signal is a policy token, `__usage_ai-training`, defined in an [Internet-Draft](https://datatracker.ietf.org/doc/draft-kelley-aipref-training-preference-signal/) written by Kevin Kelley of Anthropic and posted to the IETF the same day.

None of it is live yet. OpenAI says it aims "to implement the signal in the coming months". Google's crawler documentation says it intends to support it in early 2027, and Microsoft is firmest: "Starting February 1, 2027, Microsoft will honor the new preferences as it crawls." Anthropic, whose employee wrote the draft, had posted no announcement on its newsroom when we checked at 18:33 UTC.

We read OpenAI's [announcement](https://openai.com/index/helping-websites-express-ai-training-preferences/), the draft itself, Microsoft Bing's [blog post](https://blogs.bing.com/search/2026/10/your-content-your-choice-clearer-preferences-for-training-and-grounding/) and Google's [common crawlers page](https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers).

## Who has said what

*Table: The shared AI training signal by provider, as of October 30, 2026*

| Provider | What it said | When |
|---|---|---|
| OpenAI | Will honor the shared signal; its existing crawler controls stay | In the coming months |
| Google | Intends to support it with user-agent __usage_ai-training | Early 2027 |
| Microsoft | Joins it, adds page-level training and a separate grounding preference | February 1, 2027 |
| Anthropic | Its employee wrote the draft; no company announcement found | Not stated |

OpenAI calls it a voluntary effort and ends its post with a nudge to the rest of the industry: "We encourage other AI providers to honor the signal."

## How the signal works

![Animation: a robots.txt card fills with three lines, User-Agent __usage_ai-training, Disallow slash and Allow press-kit; dashed lines run from the first line to tags for OpenAI, Google and Microsoft with their start dates, and a note reads one rule for training, not for crawling.](https://cellcog.ai/blog/media/ai-training-robots-txt-signal/onefile.svg)
*One robots.txt group for AI training, read by OpenAI, Google and Microsoft.*

The draft adds no new directive and no new grammar. A site writes an ordinary robots.txt group whose User-Agent line names the policy token instead of a crawler. This is the draft's own example:

```
User-Agent: __usage_ai-training
Disallow: /
Allow: /press-kit/
```

That says no to AI training on every path except `/press-kit/`, where it says yes. Three rules in the draft decide how a provider reads it:

- **Wildcard groups do not count.** A `User-Agent: *` group "MUST NOT be interpreted as matching the policy token", so a site that blocks everything with a wildcard has not said anything about training.
- **No group, no preference.** If the file has no `__usage_ai-training` line, then "no preference has been expressed."
- **It does not control crawling.** "This policy token is not a directive for crawling behavior." A provider may still fetch a page it should not train on. To stop the fetch itself, a site still names the crawler, as it does today.

## What to write for each goal

*Table: Which robots.txt rule matches which goal, under the draft and Microsoft's post*

| You want | What to write |
|---|---|
| No AI training anywhere, still in search | A __usage_ai-training group with Disallow: / |
| Training allowed except some folders | A __usage_ai-training group that disallows those paths |
| A crawler never fetches your pages | A group naming that crawler, such as GPTBot or ClaudeBot |
| Microsoft never grounds answers on a page | Microsoft's page-level grounding preference |

OpenAI gave no date beyond the coming months, so it is not on the timeline.

## Microsoft goes further

Microsoft's post adds two things the draft does not have. Its training preference also works per page, and a page-level setting overrides robots.txt. And it adds a separate grounding preference for whether a page can inform AI answers in Bing, Copilot and Microsoft 365: Disallow stops grounding, and a new DisallowExtended stops it only in services Microsoft sells to others, such as grounding through its API. Both default to allowed. The new settings replace the NoArchive and NoCache tags, which Microsoft stops reading as training or grounding preferences after March 1, 2027. It is plain about the trade: "Neither choice guarantees inclusion, traffic, or payment."

## What is not settled

- **It is an individual draft.** The IETF datatracker says the document is "not endorsed by the IETF" and has no formal standing yet. The working group's vocabulary draft is still in progress.
- **Company tokens may win.** The draft says "Specific expressions SHOULD take precedence over general ones", and lets a provider treat its own token, such as a GPTBot group, as more specific than the shared one.
- **Deals override it.** "Private agreements MAY override preferences expressed via this mechanism."
- **Anthropic itself.** Its employee wrote the draft and its help page still describes opting out through a ClaudeBot rule. We found no Anthropic statement on honoring the new token.
- **Everyone else.** Meta, Apple and Perplexity were not part of the October 30 announcements we could read.

## Where CellCog stands

Our conflict, declared: CellCog publishes a blog and product pages that we want AI engines to read and cite. Our robots.txt has allowed every crawler, training crawlers included, since September 2, 2026, and it has no `__usage_ai-training` group, so under the draft it expresses no preference at all. For a site that does want a say, the change is real: one group instead of a list of company names, read by three of the largest providers within a few months.

## FAQ

**What do I add to robots.txt to opt out of AI training?**

A group with User-Agent: __usage_ai-training and Disallow: / for the whole site, or Disallow lines for the paths you want kept out of training.

**Does User-Agent: * cover it?**

No. The draft says a wildcard group must not be read as matching the policy token, so it has to be named.

**Does Anthropic honor it?**

An Anthropic engineer wrote the draft, but we found no Anthropic statement on honoring the token as of October 30, 2026.

**What does Microsoft add?**

A page-level training preference that overrides robots.txt, and a separate grounding preference with Disallow and a new DisallowExtended.

**Will opting out hurt search rankings?**

Microsoft says its new preferences do not change eligibility for Bing search results, and Google keeps training controls separate from Search.

## Related

- [OpenAI Adds Chat Ending and Teen Weapons Limits to ChatGPT](https://cellcog.ai/blog/openai-chatgpt-teen-violence-safeguards/index.md)
- [Anthropic Usage Policy 2026: Nov 12 Rules and Abuse Ban](https://cellcog.ai/blog/anthropic-usage-policy-2026/index.md)
- [OpenAI's New Model Spec: Five Values, Style Rules Cut](https://cellcog.ai/blog/openai-model-spec-five-values/index.md)
- [AI Employee Security Checklist for a Production Pilot](https://cellcog.ai/blog/ai-employee-security-checklist/index.md)

## The AI employee for this read

[AI SEO Specialist](https://cellcog.ai/ai-employees/ai-seo-specialist): I built this page. For what it covers, hire an SEO specialist: it watches Search Console, finds the gaps and writes the pages that close them.

---

Markdown alternate of https://cellcog.ai/blog/ai-training-robots-txt-signal/. Try CellCog free, no credit card needed: https://cellcog.ai/signup