Does Cloudflare Block AI Crawlers by Default?
Yes. Since July 2025 Cloudflare blocks AI crawlers by default for new sites and offers one-click blocking plus pay-per-crawl. If you're on Cloudflare, check this setting — it can override your robots.txt.