Skip to content

Sitemap URL Extractor

This sitemap URL extractor pulls every URL out of an XML sitemap, a sitemap index or a gzipped .xml.gz file, and finds the sitemaps for you when you enter a domain instead.

Try it on or , which lists more URLs than one run returns. A domain works: the extractor finds its sitemaps first.

Note

We fetch each sitemap from our server, follow every redirect ourselves and read the file as the site sends it, decompressing .xml.gz on the way. Sitemap indexes are followed up to 3 levels down. One run returns up to 50,000 URLs from up to 60 sitemap files, stops after 14 seconds and at the first HTTP 429 from the site, and always says when the list is not complete. Results are kept for ten minutes so a shared link opens without refetching, then deleted.

It follows nested indexes, merges URLs that appear twice and puts a summary above the list: how many URLs there are, which folders hold them, how recent their lastmod dates are and which ones sit on another host. Filter the table, copy the list or download it as CSV or TXT. No sign-up and no email.

Use this tool often? Bookmark this page, so it is one click away next time.

Email me this result

Want a copy for your records or a client? Leave your email and we'll send you this result. It is written by a real person at Crawl Cove, not an automated blast, so it may take a little while to arrive. We'll only use your address to send it, unless you also tick the box below. Privacy policy.

That email address doesn't look right. Please check it and try again.

Something went wrong saving your address. Your result above is unaffected; please try again.

Got it. We'll email your result to you. Nothing else lands in your inbox unless you ticked the tips box.

How to extract the URLs from a sitemap

  1. Enter a sitemap or a site

    Paste the address of a sitemap, a sitemap index or a .xml.gz file. A domain such as example.com works too: the extractor reads its robots.txt and the usual sitemap addresses to find the sitemaps first.

  2. Read the summary

    The top of the result gives the number of URLs, any repeated in more than one sitemap, any on another host, a count per top-level folder and how many have a lastmod in the last 30 days, the last year, before that or not at all.

  3. Filter the list

    Type part of a URL into the filter to narrow the table to one folder, product type or keyword. The table shows the source sitemap and lastmod of each URL.

  4. Copy or download

    Copy every URL to the clipboard, or download them as a CSV with lastmod and source sitemap columns, or as a plain TXT list with one URL per line.

How the sitemap URL extractor works

Give it a sitemap address and it reads that file. Give it a domain or a page and it looks for the site's sitemaps the way the sitemap finder does: the Sitemap: lines in robots.txt first (up to ten of them), then the addresses sitemaps usually live at, such as /sitemap.xml and /sitemap_index.xml, one at a time until one answers with a sitemap. A sitemap index is opened and every sitemap it names is read, and an index inside an index is followed too, up to three levels down. Gzipped files are decompressed as they arrive. Each URL is kept once, with its lastmod and the sitemap that first listed it; a URL that appears again is counted as a repeat instead of being added twice. Every file is fetched from our server through the same guards as our other sitemap tools, and the run stops at the first HTTP 429 from the site.

find every sitemap a site has

What the summary tells you

The folder table is a quick content inventory: on a shop you see how many URLs sit under /products/, /collections/ and /blogs/, and on a news or government site you see which sections carry the weight. Run it on a competitor and you see how many product pages, guides or location pages they publish, and from the lastmod buckets, how much of it they have touched recently. Treat lastmod as the site's own claim; some sites stamp every URL with the date the file was built. Before a migration, extract the old site's list so you have every URL that needs a redirect, then run the new sitemap after launch and compare the two. URLs listed in more than one sitemap usually mean two plugins or two feeds overlap. URLs on another host break the sitemaps.org rule that a sitemap lists URLs on its own host, for example when a site moved from www to the bare domain and the sitemap still lists the old host.

the site migration SEO checklist

Sitemap indexes and gzipped sitemaps

The sitemaps.org protocol limits one sitemap to 50,000 URLs and 50 MB (52,428,800 bytes) uncompressed, so a bigger site splits its URLs across several files and lists them in a sitemap index. An index may list up to 50,000 sitemaps and has the same 50 MB limit. Any of these files may be compressed with gzip, which is what the .xml.gz ending means, but the limit applies to the size once decompressed. Google adds that the sitemaps an index names must sit on the same site, in the same folder as the index or below it, unless you have set up cross-site submission. We checked both sets of rules against sitemaps.org and Google's Search Central documentation in November 2026. You never need to unzip a file or open the children one by one here: paste the index and the extractor reads the whole tree.

Search Console indexing issues explained

Limits, and why they are there

One run returns up to 50,000 distinct URLs, reads up to 60 sitemap files and stops after 14 seconds. The list comes back to your browser in one piece so the filter and downloads work without another request, and 50,000 rows, one full sitemap's worth, is what our server can hold and send back in one go. When a site lists more, the result says so plainly, as the first 50,000 of at least the number the files read contained, and lists every child sitemap that was not read. Paste one of those into the extractor on its own to get its URLs. As an example, when we ran it on GOV.UK in November 2026, its index named 36 child sitemaps and the ones we opened held 25,000 URLs each; the run stopped at 50,000 URLs and named the sitemaps it had not opened. A file larger than 50 MB uncompressed is reported instead of read, because that already breaks the protocol.

check the pages in one sitemap

What to do with the list

Check it: a sitemap should only list pages that answer 200, are indexable and name themselves as canonical, and the XML sitemap checker tests the URLs in one file for exactly that. Map redirects: during a migration the CSV is the starting column of your redirect map, and the .htaccess redirect generator turns old and new pairs into rules. Find gaps: compare the list with a crawl of the site, because pages the crawl reaches that the sitemap leaves out, and sitemap URLs nothing links to, are both worth a look. Feed other tools: the TXT download is one URL per line, ready to paste into a crawler's list mode or a spreadsheet.

write redirect rules for a list of URLs · find orphan pages with the orphan page checker

Frequently asked questions

What is a sitemap index?
A sitemap index is a file that lists other sitemaps instead of pages. A single sitemap may hold at most 50,000 URLs or 50 MB uncompressed, so a bigger site splits its URLs across several files and lists them in an index, and many CMSs use one anyway to split posts, pages and products into separate files. Paste the index here and every sitemap it names is read.
Can I extract URLs from a compressed sitemap?
Yes. Paste the .xml.gz address and the file is decompressed as it downloads, then read like any other sitemap. Gzipped child sitemaps inside an index are handled the same way. The 50 MB limit is checked against the decompressed size, as the sitemaps.org protocol requires.
How many URLs can the sitemap URL extractor extract?
Up to 50,000 distinct URLs in one run, from up to 60 sitemap files, within 14 seconds. Most sites list fewer and come back complete. When a site lists more, the result shows the first 50,000, says how many the files read contained in total and names every sitemap left unread, so you can run those one at a time.
Why are some pages missing from the sitemap?
Sitemaps are usually generated by the CMS or an SEO plugin, which leaves out what its settings exclude: noindexed pages, some post types, tag or author archives, or pages added outside the CMS. Some plugins also cap each file and split the rest into further sitemaps, so check the index lists all of them. A crawl of the site is the way to find pages that exist but are not in the sitemap.
Can I extract the URLs from a competitor's sitemap?
Yes, a sitemap is a public file and this reads whatever the site publishes. The folder table and lastmod buckets show how their content is split and how much of it they have updated recently. If their sitemap is not at a standard address and robots.txt does not name it, enter the full sitemap address instead of the domain.
What is in the CSV and TXT downloads?
The CSV has three columns: the URL, its lastmod as the sitemap wrote it, and the sitemap that listed it. The TXT file is one URL per line with nothing else. Both hold every URL extracted, not only the rows shown on the page, and both respect the filter when one is typed.

From one page to your whole site

This lists what a sitemap claims. Crawl Cove reads the same sitemaps on every crawl and compares them with the pages it actually reaches, so you see sitemap URLs that redirect, break or are noindexed, and indexable pages the sitemap leaves out. See audit an XML sitemap across your whole site or find pages no other page links to.

Download free