The checks
Twelve checks, from outside, the way a crawler sees a site
Each page says what the check reads, why it matters for search and for AI assistants, how to fix it with a concrete example, and what we report. Every claim carries its source.
AI search readiness
4 checks
- AI crawlersHow the AI crawlers check reads robots.txt for five documented AI user agents, what blocking each one means, how a CDN's managed robots.txt can block them for you, and how to allow or refuse them deliberately.
- llms.txtWhat the llms.txt check fetches, what the llms.txt proposal asks for, and a minimal file that satisfies it.
- Structured dataWhat the structured data check looks for in the raw HTML, why JSON-LD is the recommended format, and a minimal block to start from.
- Content without JavaScriptWhat the content-without-JavaScript check measures, why crawlers that do not render see an empty app shell, and how server rendering fixes it.
Technical health
6 checks
- HTTP statusWhat the HTTP status check records for the checked page, why anything but a 200 after redirects matters, and how to read a redirect chain.
- Time to first byteWhat the time-to-first-byte check measures, the threshold web.dev calls good, and why we report the number without grading it.
- IndexabilityWhat the indexability check reads (meta robots, X-Robots-Tag, rel=canonical), why a stray noindex is the most expensive silent failure, and how to fix the usual causes.
- SitemapWhere the sitemap check looks for a sitemap, what it validates, the protocol's size limits, and how to declare one in robots.txt.
- TLS certificateWhat the TLS certificate check reads, why a 90-day certificate needs different thresholds from a one-year one, and where to look when renewal has not happened.
- Domain registrationHow the domain registration check reads expiry from RDAP, why an expired domain is the failure nobody recovers from quietly, and what to do when a registry keeps the date private.
Security
2 checks
- Bot accessWhat the Bot access check reads in robots.txt, what a Disallow aimed at QuietwatchBot means for the other checks, and the two lines that allow it.
- Secrets in JavaScriptWhat the secrets check scans, why a secret key in client-side JavaScript is public the moment the page loads, and what a public permalink shows and hides.