OpenAI, Google, Microsoft and Anthropic back shared AI scraping opt-out
Briefing by News4U · First published
OpenAI, Google, Microsoft and Anthropic say they will adopt a shared “policy token” signal, proposed for the Internet Engineering Task Force by Anthropic standards lead Kevin Kelley, that lets publishers opt out of AI scraping through robots.txt rather than setting preferences company by company. The Verge reported the four firms will restrict AI crawlers that encounter the token; Anthropic has already adopted it, Google and Microsoft plan support next year, and OpenAI said it will implement the signal in the coming months. Microsoft will also let sites opt out of AI training or AI grounding while remaining in Bing search results. [1]
Sources
- The biggest names in AI are backing a new way to opt out of scraping
The Verge · · Full text