Free tool · no account

Is Cloudflare blocking Google from your site?

Enter a web address. In about ten seconds you see whether the site is behind Cloudflare, whether robots.txt or Cloudflare's managed section tells Googlebot, Bingbot or Applebot to stay out, whether robots.txt and the sitemap answer, and whether the page is noindexed. No account needed.

Three requests to the site, sent as QuietwatchBot, never as Googlebot. Free: 5 checks an hour per address.

Why check now

Cloudflare changed its AI crawler settings in 2026

On 1 July 2026 Cloudflare replaced its single "Block AI bots" switch with three: Search, Agent and Training. From 15 September 2026 new domains get the new defaults. Cloudflare's own documentation says a block on AI training also blocks "mixed-purpose crawlers that combine Search and Training". If a search crawler falls in that group, a setting meant for AI bots can cost a site its search traffic.

What this tool answers

  1. Is the site behind Cloudflare? Read from the response headers.
  2. Does robots.txt block search crawlers? Including whether the rule sits in the section Cloudflare writes itself, and which AI crawlers it names.
  3. Do robots.txt and the sitemap answer? A 200, or a 401, 403 or 5xx.
  4. Is the page set to noindex? In the meta robots tag or the X-Robots-Tag header.

What it cannot see

Cloudflare can also block Googlebot at the firewall (WAF/bot rules). We can't test that from outside without pretending to be Google. Check it in Search Console → URL Inspection → Live test. Google's steps for the live test. Bing has the same check under Bing Webmaster Tools → URL Inspection → Live URL.

Sources: Cloudflare changelog, 1 July 2026 · Cloudflare: Block AI bots · Cloudflare: managed robots.txt.