You shall not pass… unless you pay: Cloudflare has launched a private beta enabling customers to allow, charge, or block bot-access to their content. For it to work, bot operators such as OpenAI or Google would have to use a new protocol named Web Bot Auth and be willing to pay.
Summary
- Introducing pay per crawl: a new model for content creators to monetize AI access.
- Publishers can now control AI crawlers' access, allowing, charging, or blocking as desired.
- Web Bot Auth powers authenticated requests, enabling scalable, programmatic content monetization.
