September 15, 2026: Cloudflare's crawler split and how to configure Search, Agent and Training
From September 15, 2026 Cloudflare blocks Training and Agent crawlers by default on ad pages, and multi-purpose bots like Googlebot get caught in between. Here is how to set the three classes deliberately.
