Skip to content
Sitemap Low severity

Pages Missing From Your XML Sitemap

A real, indexable page that a crawl found but the XML sitemap never mentions. Why that slows discovery, and how to add it back safely.

A crawler can eventually find a page through internal links alone, but that is the slow route. The sitemap is the fast one: a direct list of "index these," handed straight to a search engine instead of waiting to be discovered link by link. A real, indexable page that never made it onto that list is stuck taking the slow route for no reason.

What this finding means

Crawl Cove's page-missing-from-sitemap check is the mirror of Sitemap Lists a Non-Indexable URL: instead of checking the sitemap against the crawl, it checks the crawl against the sitemap. It flags any page that is indexable (HTTP 200, not noindexed), does not redirect, canonicalizes to itself, and was actually reached by crawling your site, but is not listed anywhere in the XML sitemap.

A real finding looks like this:

indexable page is not listed in the XML sitemap: it was reached by crawling but the sitemap does not advertise it

Like its mirror check, this only runs on a full site audit, since a scoped or page-capped crawl has an incomplete picture of the site and "missing" cannot be asserted with confidence from a partial view.

Why it matters

A search engine's fastest, most direct route to a page is the sitemap. Without it, the page is still discoverable, but only via internal links, external links, or an already-known URL, all slower, and none of them carry the same explicit "please index this" signal a sitemap entry gives. For a page you actually want ranking, being left out of the sitemap means a longer wait to be found, and less certainty about its canonical status once it is.

How to fix it

  1. Confirm the page should be indexed. If it genuinely shouldn't be (a thin utility page, a duplicate, a page mid-build), noindex it instead of adding it to the sitemap; that is the honest fix, not a workaround.
  2. Check why your sitemap generator missed it. Common causes: the page lives on a route your sitemap-building code doesn't scan, it was published after the sitemap was last regenerated, or it was added through a path outside the normal content flow.
  3. Add the URL to the sitemap, or fix the generator so it picks the page up automatically going forward. The second option is worth the extra effort if this keeps happening to new pages.
  4. Crawl Cove's free XML Sitemap Checker tool will list every page like this in one pass if you want a quick read before a full re-crawl.
  5. Re-crawl to confirm the page now appears in both the sitemap and the crawl, and that the finding clears.

False positives and edge cases

  • A page that redirects, is noindexed, or canonicalizes elsewhere is never flagged as missing. Those pages correctly do not belong in the sitemap, so their absence is not a defect.
  • A sitemap advertising only a different host is treated as its own problem, not as every page being "missing". If your sitemap points at www.example.com while the crawl runs on the apex domain (or vice versa), this check stays silent rather than reporting every single page as absent: a host mismatch is one bug, not hundreds.
  • This check only runs on a full audit. On a scoped or capped crawl, the set of pages the crawl actually saw is incomplete by design, so nothing about "missing from the sitemap" can be reliably asserted.

Related reading

For the reverse problem, a URL your sitemap lists that turns out to redirect, error, or be noindexed, see XML Sitemap Contains Non-Indexable URLs.

Frequently asked questions

Does every crawled page belong in the sitemap?
No. Only indexable, HTTP 200, self-canonical pages are candidates. A page that redirects, is noindexed, or canonicalizes to a different URL is correctly left out, and this check never flags those as missing.
Is a missing sitemap entry as serious as a broken page?
No, this check defaults to low severity. A missing page can still be discovered by crawling and internal links; it is just slower to find and carries a weaker canonical signal than a sitemap entry gives it.
What if my sitemap is on a different subdomain, like www vs the apex domain?
The check deliberately stays silent in that case rather than reporting every single page as missing. A sitemap that only advertises a different host is its own, separate misconfiguration, not evidence that any individual page is absent.
Why would a real page not already be in an auto-generated sitemap?
Auto-generated sitemaps usually miss a page when it was added outside the normal content flow, is served by a route the generator doesn't scan, or was published after the sitemap was last regenerated.

Audit your site the easy way

Crawl Cove finds this on your machine, on every plan, and tells you exactly what to fix first. See the features or compare the plans.

Download Crawl Cove