Indexing
Check a page's indexability, robots directives, canonical URL, hreflang tags, and sitemap presence from the SERP Lens sidebar.
The Indexing panel shows everything that affects whether and how a page gets indexed by search engines. Open it from the browser sidebar to see robots directives, canonical URLs, hreflang tags, and sitemap information for the current page.
What it shows
URL and indexability
- The full page URL with character count
- An indexability status — whether the page is likely to be indexed based on all signals
Meta robots
All robots directives found on the page, including:
index/noindexfollow/nofollownoarchive,nosnippet,max-snippet, and others
The panel reads directives from both <meta name="robots"> tags and X-Robots-Tag HTTP headers.
Canonical URL
- The canonical URL declared on the page
- Whether it's self-referencing (points to itself) or points to a different URL
- Flags mismatches between the page URL and canonical — a common source of indexing issues
Robots.txt
- Whether a
robots.txtfile exists on the domain - A direct link to view the
robots.txtfile
Hreflang tags
A table of all hreflang tags found on the page:
| Language code | URL |
|---|---|
en-us | https://example.com/page |
de-de | https://example.com/de/page |
The list is expandable if there are many entries. Use this to verify your international targeting is set up correctly.
Sitemaps
Auto-discovers sitemaps from:
robots.txtsitemap references- Common sitemap locations (
/sitemap.xml,/sitemap_index.xml)
Shows a list of discovered sitemaps with links to view each one.
Export
Click the export button to download all indexing data as a CSV — useful for documenting indexing signals across a site audit.