Does Cloudflare Block AI Crawlers by Default?
For new domains, partly. Since Sep 15, 2026 new ad-supported domains refuse AI training and block agent bots on ad pages; search stays allowed. Existing domains keep their settings. Edge rules override robots.txt.
#cloudflare #ai-crawlers #faq