Keeping sites in Google
Plain guides to silent deindexing, noindex, robots.txt and crawler blocks: what goes wrong, how to spot it, and how to fix it.
-
Is my page noindexed? How to check in 30 seconds
Is a page noindexed? A free checker names the meta tag, header or redirect hop responsible, plus how to check by hand with view-source and curl in two steps.
Updated 2026-10-12 -
X-Robots-Tag noindex: the invisible noindex your CMS doesn't show
X-Robots-Tag is a noindex sent as an HTTP header by the server, host or CDN, never in the page. Where it comes from, how to find it with curl, how to remove it.
Updated 2026-10-08 -
Why did my site disappear from Google after a migration? A checklist
The five reasons a site drops out of Google after a migration, the Search Console sign of each, an eight-step checklist, and what Google says about recovery.
Updated 2026-10-08 -
“Indexed, though blocked by robots.txt”: what it means and how to fix it
Why Search Console shows a page as indexed but blocked by robots.txt, where the rule comes from, and the order to fix it in so Google can read your noindex.
Updated 2026-10-08 -
“Excluded by ‘noindex’ tag” in Search Console: what it means and how to fix it
Why Search Console says a page is excluded by a noindex tag, the four usual causes, and how to find and remove the noindex so Google indexes the page again.
Updated 2026-10-08