Skip to content

Sitemap issues

Every Sitemap finding Crawl Cove's crawler checks for, each with an example finding and a step-by-step fix.

Sitemap findings compare your XML sitemap with what the crawl actually found. A sitemap is the list of URLs you want indexed, so it only helps while it agrees with the site.

It can disagree in two directions. It can list URLs that should not be there: non-indexable URLs in the sitemap covers entries that redirect, return errors, carry noindex or were never reached, each of which spends crawl budget on a page you do not want shown. Or it can leave out pages that should be there: real, indexable pages that the crawl reached through links but the sitemap never names, so search engines learn about them more slowly.

The third finding is a hostname mismatch. When every URL in the sitemap names a different host from the one you crawled, and that host serves the site too, you have two live copies competing for the same signals. The page explains how to pick one host and redirect the other.

The dates can be wrong too. When every <lastmod> in the file is the same, or the time the sitemap was built, search engines cannot tell which pages changed and stop trusting the field: see sitemap lastmod dates Google cannot trust.

Last, crawlers need to find the file. A sitemap that robots.txt never names is found only by engines you submitted it to, or by guessing its address: add your sitemap to robots.txt is a one-line fix. The opposite mistake is worse: robots.txt pointing at a sitemap that 404s sends every crawler that follows it to a file that is not there.

Find what is wrong with your site
and how to fix it

Crawl Cove runs on your own computer, explains every issue in plain words and puts the most urgent fixes first. Connect Search Console and it weighs each fix by the traffic on that page.

Download free
See pricing

Free plan, no account or card needed. Paid plans add exports, reports, scheduling and more, with a 14-day trial. 14-day money-back guarantee once you subscribe.