Should You Block AI Crawlers on Your Website?
Until recently, deciding whether to let artificial intelligence crawlers read your website was a philosophical question. As of September 2026 it is a configuration setting with a default — and for new domains on Cloudflare, that default now blocks two…