OpenAI, Google, Microsoft propose common robots.txt rule to block AI training

The move addresses growing concerns among bloggers and publishers about unauthorized use of their content for training models like ChatGPT. However, the mechanism does not resolve copyright disputes or guarantee compliance from all crawlers. Users on platforms like note may also face limitations, as they often lack direct access to edit robots.txt files. The proposal distinguishes AI training opt-outs from search engine crawling rules, clarifying that refusing training does not necessarily remove content from search results—though some AI-generated search features may still reference it.