AI Policy2026-10-31The Verge

AI giants back new scraping opt-out standard

OpenAI, Google, Microsoft, and Anthropic have signaled that they will adopt a new shared standard allowing publishers to opt out of AI scraping. The mechanism is intended to let websites communicate their preferences about AI training across multiple companies at once, rather than configuring a separate signal for each provider. The move comes amid rising friction between AI developers and publishers over copyrighted material and the use of web content in training data. A common opt-out standard could make compliance simpler for websites and more predictable for AI companies. It may also reduce the administrative burden on smaller publishers that lack the resources to negotiate individually or manage many different technical preferences. At the same time, an opt-out signal is not a complete solution to the broader debate. Questions remain about how such preferences are expressed, how they are enforced, and how they interact with existing legal rules and licensing agreements. The fact that several major AI companies are backing one approach is still significant. It suggests that industry players see value in a more coordinated system, even as regulators and courts continue to examine data use. For publishers, the standard may offer a clearer way to state their choices. For AI developers, it could lower the risk of accidental noncompliance and improve trust with content owners. The practical impact will depend on adoption beyond the initial companies and on whether the standard is implemented consistently. The announcement therefore marks a step toward more formal rules of the road for AI scraping, but not the end of the dispute over how valuable content should be used and compensated.

Related news