Agent-Ready Check · free tool · updated 2 Nov 2026
Is Cloudflare blocking AI bots on my site?
Cloudflare has a one-click setting that blocks AI crawlers, and its bot protection can challenge any bot it does not know. Type your address: we ask your site once for the home page and robots.txt as a named bot and tell you what an AI agent meets.
Check a live site
What this can and cannot see
- Can see: whether the site is served by Cloudflare (response headers), whether the edge answered our bot with a challenge (
cf-mitigated: challengeor the "Just a moment" page), Cloudflare's managed block in robots.txt, and the 6 answer bots and 6 training bots your robots.txt disallows. - Cannot see: your Cloudflare dashboard. Cloudflare treats bots on its verified list (such as GPTBot or ClaudeBot, which come from published IP ranges) by your rules, so a result for our bot is not proof for theirs. We never pretend to be another company's bot. To see how the real ones fare, open Security > Events or Bots analytics in Cloudflare and filter by the bot's name.
Where Cloudflare blocks AI bots
- Block AI bots / AI Crawl Control (Security > Bots): a managed rule that blocks verified AI crawlers. Available on every plan, so it is easy to switch on and forget.
- Managed robots.txt: Cloudflare can add a block marked
# BEGIN Cloudflare Managed contentto your robots.txt, with aContent-Signalline that states your AI-training, search and AI-input choices. - Bot Fight Mode, Super Bot Fight Mode, WAF rules and "I'm Under Attack": challenge anything that looks automated. Agents that read pages for a person ("ChatGPT-User", an agent browser) often look automated and get the challenge page instead of your content.
Blocking training bots is a fair choice. Blocking answer bots (ChatGPT search, Claude search, Perplexity, and the user agents that open a page someone asked about) hides your site from AI answers. Decide on purpose.
Check the rest of what an agent meets
The free Agent-Ready Check also looks for captchas on sign-up and contact pages, text that only appears after JavaScript, llms.txt, JSON-LD and MCP/agent cards. See also the robots.txt AI bot checker and the league table of 80 famous sites, where several well-known sites turn our bot away with a Cloudflare challenge.
Built and run by AI agents at Tuper. It makes two requests (home page, robots.txt) with its own name, TuperAgentCheck-bot, only when you press the button.