“We noticed you may be using an ad blocker. SEO Site Checker relies on ads to keep our SEO tools free. Please consider disabling your ad blocker to support us - thank you!”“We noticed you may be using an ad blocker. SEO Site Checker relies on ads to keep our SEO tools free. Please consider disabling your ad blocker to support us - thank you!”
Check a page for noindex in its robots meta tag and its X-Robots-Tag header. See which rule applies to all robots, Googlebot and Bingbot, whether robots.txt blocks Googlebot, and the final address after redirects.
What this check reads
From our server, with our own user agent (SEOSiteCheckerBot), we fetch the address you give and the robots.txt of the website it ends on, then read the headers and the HTML that come back.
We do not run JavaScript. A noindex added by a script after the page loads is not visible here. Our SEO audit reads the page after scripts have run, so the two can differ.
We follow up to 5 redirects and check the address we end on. We keep no cookies, so a redirect that depends on one may end somewhere else than it does in a browser.
Rules for all robots, for Googlebot and for Bingbot are combined, and the stricter rule wins when they conflict, as Google documents. Rules for other crawlers are shown but not applied.
The result describes what the server sent to our check. It does not say whether a search engine has indexed the page, will index it, or how long a change takes to show up.
To see every redirect and every response header, use the Redirect Checker.
What Is a Noindex Checker?
Quick answer: A noindex checker fetches a web address and reports whether it carries a noindex rule in a robots meta tag, in the X-Robots-Tag HTTP header, or in both, and which crawlers the rule covers. Paste an address and check a page now.
This free noindex checker answers one question: what did the server send? It prints the header lines and meta tags as received, then gives the rule for Googlebot, Bingbot and all robots, plus whether robots.txt blocks Googlebot. It reports the server's answer, not search engine indexing.
Reach for it when a page vanishes from results, after a launch or template change, or when a PDF should stay unlisted. For a noindex test, start with the address that went missing, not the home page.
How to Check a Page for Noindex With This Tool
Add addresses. Type or paste one per line in the box labeled Web addresses to check. Leaving out https:// is fine.
Press Check for noindex. Each address gets a row marked Waiting, then the checks run in order (Checking 1 of 3).
Open a row. Read the headline, then Result for each crawler, then the X-Robots-Tag header and Robots meta tags blocks.
Keep or retry. Copy results keeps the answers, Download CSV (two or more rows) saves them, Stop ends a long list, and a failed row offers Try again.
Worked example: In our test on November 2, 2026, our /login page returned "Noindex found in the header and in a meta tag". The header line read x-robots-tag: noindex, nofollow. The robots meta tag agreed, and robots.txt did not block the page. Try it on your own page.
How to Read the Noindex Checker Result
Seven headlines are possible, and none claims anything about indexing. Two hinge on unavailable_after, a rule that tells search engines to stop showing a page after a date.
Headline in the result
What it means
No noindex rule found
No noindex in header or meta tags
Noindex found in a meta tag
A robots, googlebot or bingbot tag
Noindex found in the X-Robots-Tag header
The server sent it as a header
Noindex found in the header and in a meta tag
Both places carry it
Noindex found, and another rule says index
The stricter rule counts, here the noindex
Noindex starts after a date
No noindex yet: the date is ahead
Noindex: the unavailable_after date has passed
The date passed, so it counts
Under the headline come these blocks: robots.txt check for Googlebot, Result for each crawler, X-Robots-Tag header, Robots meta tags, What we fetched (HTTP status code, content type, redirects followed) and, when needed, Notes.
The canonical link element is an extra fact, not a verdict. The checker reads at most 1,000,000 bytes of a page, 200 robots meta tags and 100 X-Robots-Tag lines, and past any of those limits (Partly read) joins the headline. A test page with 250 robots meta tags and the noindex last still answered No noindex rule found (Partly read), which does not rule out a rule further down.
Meta Robots Tag Versus X-Robots-Tag Header
A robots meta tag sits in the HTML head. The X-Robots-Tag is a line in the HTTP response header, set by the server, a CDN or the application, so an accidental noindex can come from a staging site setting or an SEO plugin and never show in your CMS. Google says any meta tag rule can also go in the header, and for a PDF or an image file the header is the only option.
View source shows the document, not the envelope it arrived in, so a meta robots checker that reads only the HTML never sees a header. We print the X-Robots-Tag lines as served, and a line can start with a crawler name, as in googlebot: noindex. In our tests, a bare nofollow on the next header line then gave Googlebot both rules and Bingbot only the nofollow.
Header example: The W3C's dummy.pdf test file sends x-robots-tag: noindex (our test, November 2, 2026). The checker showed the line and marked the meta block Not applicable. A third party file can change.
Which Noindex Rule Applies to Googlebot, Bingbot and All Robots
Google's robots meta tag and X-Robots-Tag documentation states three rules the checker applies: the more restrictive rule wins, none equals noindex and nofollow, and a rule without a crawler name covers all crawlers. Six shapes from our tests, served by a test server:
What the page sends
What the checker shows
Meta robots index, follow plus a noindex header
Noindex found, and another rule says index
A googlebot noindex tag beside a robots index tag
The same headline, Noindex for Googlebot only
The header line bingbot: noindex
Noindex for Bingbot only
A robots meta tag of none
Noindex and Nofollow for all three
An unavailable_after header dated 2099
Noindex starts after a date
An unavailable_after header dated 2010
Noindex: the unavailable_after date has passed
The Result for each crawler table has the columns Crawler, Noindex rule, Links and Comes from. Links shows Follow or Nofollow. When all three agree it shows one row, and Comes from names the source and line, such as the X-Robots-Tag header (line 1).
Tags for other crawlers, such as slurp, are listed, not applied, and a misspelled name like robot earns a note. The same parser reads Bingbot, and other engines may differ.
Why robots.txt Can Hide Your Noindex
A web crawler has to fetch a page before it can read the noindex on it. If robots.txt (Robots Exclusion Protocol, RFC 9309) blocks the address, the rule is never seen, and Google's guide to blocking indexing with noindex says the page must not be blocked. A block shows as Blocked for Googlebot, with the rule and its line.
A blocked address can still be listed, without a description, if other pages link to it, so to keep a page out, serve a crawlable page that carries a noindex. For syntax, see the Disallow rule guide.
Check order: read the robots.txt result before you blame the tag. On November 2, 2026, our /login got Not blocked for Googlebot, so robots.txt was not hiding its noindex. See our post on writing a robots.txt file.
What a Noindex Tag Checker Cannot See
This noindex checker reads the raw HTML and headers the server sent to our request, and it does not run JavaScript. A noindex added by JavaScript rendering is invisible to it, and one a script removes still shows. Our SEO audit works on the rendered HTML, which is why its NoIndex Tag row in the Website SEO Score Checker and this tool can disagree about one address, in either direction.
A site may answer us differently than a browser or search engine: we send our own user agent, SEOSiteCheckerBot, never Googlebot's, and a firewall, CDN rule or login can change the reply. If a bot protection page from a known service answers, we refuse it rather than report it as your page, since such a page can carry its own noindex.
What it never says: whether a page is in a search index, whether it will be, or how long a change takes to show. For Google's own copy of a page, use the URL Inspection tool in Search Console.
X-Robots-Tag Checker Details: Redirects, Error Pages and Several URLs
We follow up to 5 redirects and judge the final URL, the end of the redirect chain, shown as Ends at. Rules on earlier hops are not read, and a meta refresh is not followed. See the guide on redirects.
Error pages are still read, since a 404 or 503 can carry an X-Robots-Tag line, and a clear result on one is marked neutral, with a status line. A 401 describes a signed-out visitor, not the page behind the login, and a bare 403 page is flagged because a firewall may have produced it. Private, local or non public addresses are refused.
Lists take one address per line: a guest can submit up to 5 addresses, a free account raises that to 20 addresses, and duplicates are checked once. Paste the http and https versions of one page together, and the redirecting row shows Ends at.
Robots.txt Tester: see whether robots.txt stops a crawler from reading the page at all.
Redirect Checker: follow an address hop by hop to the page the rule sits on.
Frequently Asked Questions
Frequently Asked Questions (FAQs) is a list of common questions and answers provided to quickly address common concerns or inquiries.
What does noindex mean?
Noindex is a robots exclusion directive that asks a search engine not to show a page in its results. It travels as a robots meta tag or an X-Robots-Tag header, and only the header covers a PDF or an image. Visitors can still open the page.
How do I check if a page has a noindex tag or header?
The fastest way is this checker, which reads both places and names the one holding the rule. To check noindex by hand, search the page source for robots, then look at the response headers for x-robots-tag in the developer tools Network tab or with curl.
What is the difference between a robots meta tag and the X-Robots-Tag header?
Same values, different place. The meta tag sits in the HTML, usually in the head, and works only for HTML pages. The header is part of the HTTP response and works for any file type, PDFs and images included. A header line can also name a crawler first.
What happens when the X-Robots-Tag header and the meta robots tag disagree?
Google applies the more restrictive rule, so a single noindex beats an index written elsewhere. The checker shows both and uses the headline 'Noindex found, and another rule says index'. In our test, a meta tag of index, follow plus a noindex header gave that headline. Other engines may differ.
Does blocking a page in robots.txt keep it out of Google?
No. Blocking stops crawling, not listing: Google says a blocked URL can still appear in Google Search results if other pages link to it, which Search Console calls 'Indexed, though blocked by robots.txt'. A blocked page cannot show its noindex, so let Googlebot crawl it and add one.
Why does the checker find no noindex when Search Console says Excluded by noindex tag?
We cannot say which of four reasons applies. A script may add the rule after the page loads. The site may answer us differently than it answers Googlebot. The rule may have been removed since Google's last crawl. Or the address differs, as with www. The URL Inspection tool in Search Console shows Google's own copy.
Can JavaScript add a noindex, and will this checker see it?
A script can insert a robots meta tag, but this noindex checker does not run scripts and will not see it. In its JavaScript SEO basics, Google says changing or removing a noindex with JavaScript may not work as expected, and that it may skip rendering a page that already has one.
How long does Google take to drop a page after I add a noindex?
Not right away, and this tool cannot tell you. Google has to fetch the page again to see the rule, and its documentation says it may take months for Googlebot to revisit a page, depending on its importance. You can request a recrawl using the URL Inspection tool.
How many pages can I check at once, and is the checker free?
It is free and needs no sign-up. A guest can check up to 5 addresses at a time, and a free account raises that to 20 addresses, one per line. It checks the pages you list and is not a site crawler. Add yours in the box labeled Web addresses to check.
We use cookies to personalize content and ads, to provide social media features and to analyze our traffic. You consent to our cookies if you continue to use our website.
Install SEO Site CheckerFree SEO tools - always in your pocket.
