# OpenAI, Google, Microsoft propose common robots.txt rule to block AI training

Digest AI · Policy & Regulation · published 2026-11-01T19:54:00Z

Canonical: https://digestai.news/story/openai-google-microsoft-propose-common-robots-txt-rule-to-block-ai-tra

## Summary

**OpenAI, Google, Microsoft, and Anthropic** announced on October 30, 2026, a draft policy to let website owners signal whether their content can be used for AI training via an updated **robots.txt** file. The mechanism, still in development by the IETF, would allow publishers to add a line like `Disallow: /` under `User-Agent: usageai-training` to refuse training access—though it does not yet block all AI companies or affect search visibility directly. OpenAI aims to implement it within months, while Google and Microsoft plan rollouts in 2027 and February 2027, respectively. Anthropic is actively supporting the draft, but the feature remains unstandardized and voluntary for now.**

The move addresses growing concerns among bloggers and publishers about **unauthorized use of their content** for training models like ChatGPT. However, the mechanism does not resolve copyright disputes or guarantee compliance from all crawlers. Users on platforms like note may also face limitations, as they often lack direct access to edit robots.txt files. The proposal distinguishes AI training opt-outs from search engine crawling rules, clarifying that refusing training does not necessarily remove content from search results—though some AI-generated search features may still reference it.

## Key points

- OpenAI, Google, Microsoft, and Anthropic propose a draft robots.txt rule to block AI training on websites
- Publishers can add `User-Agent: usageai-training Disallow: /` to refuse training access, but no company enforces it yet
- Implementation timelines vary: OpenAI aims for months, Google and Microsoft for 2027, Anthropic is actively supporting

## Why it matters

This draft could give publishers a technical way to opt out of AI training without losing search visibility, but its adoption remains uncertain. For now, it’s a step toward transparency—not enforcement—over data usage in generative AI.

## Sources

1. [Latest AI News Preventing AI from training on your articles!? OpenAI, Google, and others to adopt new common rules](https://note.com/ashichan_editor/n/nf9cacb39a7f3?hl=en) (note.com, 2026-11-01)

Part of the developing story: [AI Companies Unite on Robots.txt Training Limits](https://digestai.news/thread/openai-will-honor-a-shared-robots-txt-signal-for-ai-training-preferences) (2 stories)

## Cite

Digest AI, "OpenAI, Google, Microsoft propose common robots.txt rule to block AI training", 1 November 2026, https://digestai.news/story/openai-google-microsoft-propose-common-robots-txt-rule-to-block-ai-tra

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/openai-google-microsoft-propose-common-robots-txt-rule-to-block-ai-tra.json