Evidence you can inspect
Per URL, reports whether a noindex directive was found and whether it came from the HTML meta robots element or the X-Robots-Tag header.
A page can declare a noindex directive in its HTML or in the X-Robots-Tag response header. This free tool checks both sources on the fetched response and identifies where a directive was found.
Free to run in the app. No tokens charged. Already have an account? Log in.
Paste up to 10 URLs, one per line.
Each URL is checked for a noindex value in both the meta tag and the response header.
Per-URL flag for meta-tag noindex, header noindex, or clean.
Per URL, reports whether a noindex directive was found and whether it came from the HTML meta robots element or the X-Robots-Tag header.
A CDN, WAF or misconfigured server can inject a noindex header that never shows up if you only view page source.