A page can be accidentally excluded from search in two places: the <meta name="robots"> tag in the HTML, or the X-Robots-Tag HTTP response header. This free tool checks both, per URL.
Free to run in the app. No tokens charged. Already have an account? Log in.
Paste up to 10 URLs, one per line.
Each URL is checked for a noindex value in both the meta tag and the response header.
Per-URL flag for meta-tag noindex, header noindex, or clean.
A CDN, WAF or misconfigured server can inject a noindex header that never shows up if you only view page source.