Developing story · 2 episodes · 15 Sept to 18 Sept
Cloudflare Automates AI Bot Control
Cloudflare is expanding its AI governance tools by first allowing sites to block model training while permitting search indexing. The company has now added a dashboard feature to automatically sync these bot preferences into robots.txt files.
-
Cloudflare adds Bot Preference Sync to generate robots.txt from dashboard
Cloudflare announced Bot Preference Sync, a feature that automatically writes robots.txt entries based on the AI bot policy settings a site configures in Cloudflare’s dashboard. The tool creates a…
1 source -
Cloudflare launches Disallow AI Training to separate search indexing from model data use
Cloudflare has introduced a new security setting called "Disallow AI Training" to resolve the conflict between website discoverability and AI data usage. Previously, site owners using mixed-use…
3 sources HN 41
Who and what