Free Noindex Checker – Detect Meta Robots & X-Robots-Tag Instantly
Check whether any page is blocked from search engines. Detect meta robots tags, X-Robots headers, HTTP status codes, redirects, and indexability issues in seconds.
Enter any URL to instantly analyze robots meta tags, X-Robots-Tag headers, canonical tags, and overall indexability signals.
Indexability Verdict
—
HTTP —
Paste a URL and click "Check Noindex".
0 Errors
0 Warnings
0 Info
Meta Robots
robotsnot found
googlebotnot found
HTTP Headers
HTTP Status—
X-Robots-Tagnot found
Canonical & Robots
Canonicalnot found
Robots.txt—
Issues Found
Issues will appear after you run a check.
Recommendations
Recommendations will appear after you run a check.
Raw JSON Report (advanced)
{
"note": "Run a check to generate a report."
}
How It Works
3 Steps to Check Indexability
Run a full indexability scan in under 10 seconds — no signup, no installation required.
01
Enter URL
Paste any webpage URL into the checker. Works for any domain — your own site, competitor pages, or client URLs.
02
Scan Website
Our tool fetches the page and analyzes HTTP headers, HTML meta tags, X-Robots-Tag, canonical URLs, and status codes.
03
View Indexability Report
Get a full color-coded report with verdict, issues, recommendations, and raw signals — download as JSON anytime.
Features
Why Use This Tool
Everything you need to diagnose indexing issues — in one free, instant check.
Detect Hidden Noindex Tags
Uncover noindex directives that developers or plugins may have accidentally left on production pages.
Find Accidental Deindexing
Prevent pages from silently disappearing from Google after a plugin update or CMS migration.
Check X-Robots Headers
Analyze server-level directives that HTML-only tools miss — including noindex on PDFs and images.
Verify Indexability
Get a clear verdict: Indexable, Noindex Detected, or Potentially Blocked — with color-coded badges.
Instant Results
Full report in under 5 seconds. No login, no waiting, no rate limit on basic usage.
Responsive Design
Works perfectly on desktop, tablet, and mobile — check any URL from any device.
Comparison
Meta Robots vs X-Robots-Tag
Understanding the difference between these two directives is critical for accurate SEO auditing.
Feature
Meta Robots
X-Robots-Tag
Location
HTML <head>
HTTP response header
Works on PDFs
✗ No
✓ Yes
Works on images
✗ No
✓ Yes
Easy to implement
✓ Yes
⚙ Advanced
Supported by Google
✓ Yes
✓ Yes
Requires server access
✗ No
⚙ Yes
Per-bot targeting
✓ Yes
✓ Yes
Diagnosis
Common Indexing Problems
Know what you're looking for before you run your next audit.
🚫
Meta noindex tag
A <meta name="robots" content="noindex"> in the HTML head tells crawlers to skip this page.
📡
X-Robots header
A server-level X-Robots-Tag: noindex header blocks indexing — invisible in browser source view.
🤖
robots.txt blocking
Disallow rules in robots.txt can prevent Googlebot from crawling certain URL paths entirely.
🔀
Redirect chains
Multiple hops between redirects dilute crawl budget and can confuse search engine indexing signals.
💔
404 pages
Pages returning 404 or 410 status codes won't be indexed and may hurt site credibility over time.
🔗
Canonical problems
A mismatched or missing canonical tag can cause Google to index the wrong version of your content.
⚠️
Server errors
5xx server errors signal that the page isn't reliably available, causing Google to drop it from the index.
⏳
Temporary redirects
A 302 redirect tells Google the move is temporary — PageRank won't transfer to the destination URL.
Code Reference
Syntax Examples
Common robots directives you'll encounter when auditing pages.
Noindex — HTML
<metaname="robots"content="noindex">
Prevents all search engines from indexing this page. Google will remove it from search results after the next crawl.
Indexable — HTML
<metaname="robots"content="index,follow">
Explicitly allows indexing and link-following. This is the default behavior — adding it is optional but makes intent clear.
X-Robots-Tag — Header
# HTTP response headerX-Robots-Tag: noindex# Or with bot targeting:X-Robots-Tag: googlebot: noindex
Server-level directive. Apply to any resource type including PDFs, images, and XML feeds — not just HTML pages.
SEO Guide
7 Reasons Your Page Isn't Being Indexed
1
Meta noindex tags
The most common cause. A single tag in the HTML head is enough to block indexing for the entire page.
2
X-Robots-Tag headers
Set at the server level, these are often missed by standard SEO tools that only parse HTML.
3
robots.txt restrictions
Disallow rules block Googlebot from crawling specific paths. Blocking and noindex interact in complex ways.
4
Canonical conflicts
A self-referencing or cross-domain canonical that points to a different URL tells Google which version to index.
5
Redirect chains
Too many hops between URLs wastes crawl budget and can result in the final destination not being indexed.
6
404 or server errors
Pages that consistently return error status codes are eventually dropped from Google's index entirely.
7
Crawlability issues
JavaScript-heavy pages, deep pagination, or low internal linking can prevent Googlebot from discovering content.
What is a Noindex Tag?
A noindex directive is an instruction to search engine crawlers telling them not to include a specific page in their search index. It can be delivered via a meta robots tag in HTML, via an X-Robots-Tag HTTP header, or through the googlebot-specific meta tag. When Google encounters a noindex signal, it will continue to crawl the page but will not include it in search results.
When Should You Use Noindex?
Noindex is appropriate for pages you genuinely don't want ranked: admin dashboards, thank-you pages, staging environments, duplicate content, filtered URLs with parameters, or paginated archive pages. The mistake is applying it accidentally — which this tool helps you detect.
Noindex vs robots.txt — What's the Difference?
robots.txt controls whether a bot can crawl a URL at all. Noindex controls whether a crawled page gets indexed. If you block a page in robots.txt, Google can't read the noindex tag — so the page may still appear in search results based on external links pointing to it. For proper deindexing, use noindex on a page Google can still crawl.
How Long Does It Take for Noindex to Take Effect?
After adding a noindex tag, Google typically removes the page from its index within days to a few weeks — depending on how frequently the page is crawled. High-authority, frequently updated pages are processed faster. You can speed this up by requesting removal in Google Search Console.
FAQ
Frequently Asked Questions
Everything you need to know about noindex tags, X-Robots-Tag headers, and Google indexing.
A noindex tag is a directive placed in a webpage's HTML or HTTP headers that instructs search engine crawlers not to add the page to their index. It's the most direct way to tell Google: "don't show this page in search results." The tag does not prevent crawling — only indexing.
Enter the URL in this Noindex Checker tool and click "Check Noindex." The tool will scan the page's HTML meta tags, X-Robots-Tag HTTP headers, and HTTP status code to give you a clear verdict. You can also manually inspect the page source and search for meta name="robots".
X-Robots-Tag is an HTTP response header that serves the same purpose as the meta robots tag but at the server level. Its key advantage is that it works on any file type — PDFs, images, XML files, and more — not just HTML pages. It's configured in your web server or CDN settings rather than in the HTML source.
Yes — intentionally and unintentionally. Used properly, noindex improves your site's quality signals by keeping low-value pages out of Google's index. Used accidentally, it can cause important pages to vanish from search results entirely, causing a drop in organic traffic. Regular noindex audits are a key part of technical SEO maintenance.
In rare cases, yes. If a page is blocked by robots.txt, Google cannot read the noindex tag and may still show the page in search results (without a snippet) because it knows the URL exists from external links. To properly remove a page, ensure it's crawlable so Google can read and respect the noindex directive.
For HTML pages, meta robots is easiest to implement via your CMS or SEO plugin. For non-HTML resources (PDFs, images), X-Robots-Tag is the only option. If you need to apply directives across all file types on a domain consistently, X-Robots-Tag at the server level is more robust. Both are supported by Google equally.
Possible causes include: robots.txt blocking the URL path, a canonical tag pointing to a different URL, the page returning a 4xx or 5xx status code, thin or duplicate content causing Google to choose not to index it, or the page simply not having been discovered or crawled yet. Use Google Search Console's URL Inspection Tool alongside this checker to diagnose further.
In Yoast SEO: edit the page, go to the Yoast panel, click "Advanced," and set "Allow search engines to show this post in search results" to Yes. In Rank Math: open the Rank Math panel, go to "Advanced," and disable the "Robots Meta Noindex" setting. Also check WordPress Settings → Reading to ensure "Discourage search engines" is unchecked.
Directly, no — robots.txt blocks crawling, not indexing. However, if Google can't crawl a page to read its noindex tag, it may still index the URL based on external links, showing a result with no snippet. Indirectly, blocking crawl access is often the practical equivalent of blocking indexing for pages Google has never encountered before.
The main factors are: a noindex directive (meta tag or X-Robots-Tag), a canonical pointing elsewhere, robots.txt blocking (prevents crawling), HTTP error codes (4xx/5xx), password protection, poor quality or thin content, redirect chains, no-follow on all internal links, or the page simply not being linked from anywhere Google has crawled.
More Tools
Related SEO Tools
Round out your technical SEO audit with these companion tools.