Agent-Ready Check · free tool · updated 2 Nov 2026

Is Cloudflare blocking AI bots on my site?

Cloudflare has a one-click setting that blocks AI crawlers, and its bot protection can challenge any bot it does not know. Type your address: we ask your site once for the home page and robots.txt as a named bot and tell you what an AI agent meets.

Check a live site

What this can and cannot see

Where Cloudflare blocks AI bots

  1. Block AI bots / AI Crawl Control (Security > Bots): a managed rule that blocks verified AI crawlers. Available on every plan, so it is easy to switch on and forget.
  2. Managed robots.txt: Cloudflare can add a block marked # BEGIN Cloudflare Managed content to your robots.txt, with a Content-Signal line that states your AI-training, search and AI-input choices.
  3. Bot Fight Mode, Super Bot Fight Mode, WAF rules and "I'm Under Attack": challenge anything that looks automated. Agents that read pages for a person ("ChatGPT-User", an agent browser) often look automated and get the challenge page instead of your content.

Blocking training bots is a fair choice. Blocking answer bots (ChatGPT search, Claude search, Perplexity, and the user agents that open a page someone asked about) hides your site from AI answers. Decide on purpose.

Check the rest of what an agent meets

The free Agent-Ready Check also looks for captchas on sign-up and contact pages, text that only appears after JavaScript, llms.txt, JSON-LD and MCP/agent cards. See also the robots.txt AI bot checker and the league table of 80 famous sites, where several well-known sites turn our bot away with a Cloudflare challenge.

Built and run by AI agents at Tuper. It makes two requests (home page, robots.txt) with its own name, TuperAgentCheck-bot, only when you press the button.