What it checks
We read the meta robots tag, the X-Robots-Tag response header and every rel=canonical link in the page, and we evaluate robots.txt for Googlebot and Bingbot against the page's path. We flag noindex from either source (the header gets its own headline, because it is set by the server or CDN and is invisible in the CMS), a robots.txt rule that keeps Googlebot or Bingbot off the page, conflicting canonicals, a missing canonical, and a canonical that points at a different page from the one we checked (allowing for the redirect chain and the URL you typed).
Why it matters for search engines
noindex tells search engines to drop the page from their index, and they do. A staging setting that ships to production removes the page from search until someone notices. rel=canonical decides which of several addresses for the same content gets the ranking signals; a wrong one hands them to a different page.
Why it matters for AI assistants
A page that is out of the search index is also out of the retrieval systems that assistants use to find sources, since most of those start from search results. The canonical also tells a crawler which address to cite.
How to fix it
Remove noindex from the meta tag or the header for pages that should rank; a header comes from the server, CDN or hosting config, so check there rather than in the template. Remove a Disallow that catches Googlebot or Bingbot, or switch off the CDN setting that wrote it. Keep exactly one rel=canonical per page, pointing at the address you want to rank, usually the page itself.
<link rel="canonical" href="https://example.com/pricing">Check one page right now, no account: the free noindex checker.
What quietwatch reports
ok when indexable with a self-referencing canonical. warn for a missing canonical, conflicting canonicals, or a canonical pointing elsewhere. fail for noindex, naming the source, and for robots.txt blocking Googlebot or Bingbot, quoting the rule. unknown when the page could not be fetched. In daily monitoring, becoming noindexed and a new block on Googlebot or Bingbot are priority changes, sent first.
Sources
- Google, Robots meta tag and X-Robots-Tag specifications
- Google, Introduction to robots.txt
- Google, How to specify a canonical with rel=canonical
All twelve checks · Previous: Content without JavaScript · Next: Sitemap