XML sitemap generator, free, for up to 500 URLs
This XML sitemap generator crawls your site from the page you enter, following links the way a search engine does, and writes a sitemap.xml of the pages that belong in one.
Try it on or enter any public site. 100 URLs take about a minute and 500 take several, because the crawl paces itself.
No page qualified for the sitemap. The reasons are listed below.
Left out of the sitemap, and why
Next steps
- Upload sitemap.xml to the root of your site, so it loads at .
- Add this line to robots.txt:
- Submit it in Google Search Console under Indexing, then Sitemaps, and in Bing Webmaster Tools.
- Check the live file with the XML sitemap validator once it is uploaded.
Keep the sitemap honest after today
A sitemap file goes stale as the site changes. Crawl Cove checks the one you publish against a crawl of the site: indexable pages missing from it, listed URLs that redirect, fail, are noindexed or canonicalised elsewhere, lastmod dates that only record when the file was made, and a sitemap robots.txt does not name. The Free plan crawls up to 1,000 URLs.
Download Crawl Cove freeNote
It is free for up to 500 URLs and needs no sign-up. Every URL it leaves out is listed under its reason, so you can see which pages redirect, return an error, carry a noindex, point their canonical somewhere else or are blocked by robots.txt.
Use this tool often? Bookmark this page, so it is one click away next time.
Email me this result
Want a copy for your records or a client? Leave your email and we'll send you this result. It is written by a real person at Crawl Cove, not an automated blast, so it may take a little while to arrive. We'll only use your address to send it, unless you also tick the box below. Privacy policy.
Got it. We'll email your result to you. Nothing else lands in your inbox unless you ticked the tips box.
How to generate an XML sitemap
-
Enter your home page
The crawl starts there and follows links to other pages on the same site. Choose a limit of 100, 250 or 500 URLs.
-
Let it crawl
The counters show pages fetched, waiting and included. Stop it at any time and the sitemap is built from what it found so far.
-
Read what was left out
Excluded URLs are grouped by reason: redirect, error, noindex, canonical elsewhere, not HTML and blocked by robots.txt. Open a group to see each URL.
-
Download sitemap.xml
Download the file or copy it, upload it to your site root, add a Sitemap: line to robots.txt and submit it in Search Console.
What an XML sitemap is
An XML sitemap is a file, usually at /sitemap.xml, that lists the pages on a site you want search engines to find and index. Each address sits in a <loc> tag inside a <url> entry, and the entries sit inside one <urlset> that names the sitemaps.org namespace. Search engines find most pages by following links, so a small site with good internal links can manage without one. A sitemap helps most on a new site that few other sites link to, on a large site where some pages sit many clicks deep, and on a site that adds pages often. Google treats it as a hint: listing a URL does not make Google index it, and leaving one out does not keep it out of the index.
How this XML sitemap generator works
Your browser runs the crawl and our server fetches the pages for it. From the address you enter, the generator requests pages two at a time, reads the links in each page's HTML and queues every new address on the same site, level by level, until it reaches your limit or runs out of links. robots.txt is read first and obeyed, so a path closed to Googlebot or to all crawlers is never requested. Links marked rel="nofollow" are not followed, and nor is anything on a page whose meta robots tag says nofollow. Addresses with a query string are skipped unless you tick the box, because sort orders and filters can turn one page into hundreds. Links that JavaScript adds after the page loads are not in the HTML, so pages reached only through them are not found.
What goes in, what is left out, and why
A URL goes into the sitemap when it answers 200 with an HTML page, has no noindex in its meta robots tag or X-Robots-Tag header, and either has no canonical tag or has one naming itself. Everything else is listed under the reason it was left out. A redirect is left out because the sitemap should name the page it lands on, which is crawled in its place when it is on the same site. A canonical naming another URL is left out for the same reason, and that URL is queued instead. Errors, noindexed pages, files that are not HTML, such as PDFs and images, and paths robots.txt blocks are listed too. The free generators we tried in November 2026 show a count of skipped pages at most. This one names each page and the reason, so a page you expected to see is easy to trace.
why non-indexable URLs do not belong in a sitemap · check why one page is not indexable
lastmod, priority and changefreq
Google ignores <priority> and <changefreq>, so this generator leaves both out. Google does use <lastmod>, but only when the dates are consistently and verifiably accurate, and a run of wrong dates teaches it to ignore the field. So <lastmod> is written only when a page sends a Last-Modified header, and only when that date is not simply the moment of the request: many servers stamp every response with the current time, and a sitemap full of today's date says nothing. You can untick the option to leave <lastmod> out entirely. A content system that records when each page was edited can write better dates than any crawler.
Sitemap size limits
One sitemap file can hold up to 50,000 URLs and must be no bigger than 50 MB uncompressed. A larger site splits its URLs across several files and lists those files in a sitemap index. This generator stops at 500 URLs, so its output always fits in one file. Every URL in a sitemap must be a full address, with https:// and the host, on the same host as the sitemap file. The file is UTF-8, and characters such as & in a URL are written as &, which the generator does for you.
Where to put the sitemap and how to submit it
Upload sitemap.xml to the root of your site, so it answers at https://example.com/sitemap.xml. A sitemap in a folder can only list pages in that folder, which is why Google recommends the root. Then add one line to robots.txt, Sitemap: https://example.com/sitemap.xml, so any search engine that reads robots.txt can find it. Submit it in Google Search Console under Indexing, then Sitemaps, and in Bing Webmaster Tools. Once the file is live, run it through our XML sitemap validator to confirm every URL in it loads and nothing in it redirects.
XML sitemap validator · add the Sitemap: line with the robots.txt generator · a sitemap robots.txt does not name
WordPress, Shopify and other platforms
Most platforms already write a sitemap and keep it up to date. WordPress has served one at /wp-sitemap.xml since version 5.5, and SEO plugins such as Yoast SEO and Rank Math replace it with /sitemap_index.xml. Shopify, Wix and Squarespace publish /sitemap.xml for every site. Use the one your platform makes, because it changes when you publish and a file from here does not. A generated file suits a static or hand-built site. On a platform site it is still useful as a cross-check: if a page shows up here as noindexed or canonicalised elsewhere but your platform's sitemap lists it, one of the two is wrong.
Frequently asked questions
- Is this XML sitemap generator free?
- Yes, with no sign-up and no email. Each run can crawl up to 500 URLs. The browser asks our server for a few pages at a time and paces itself, so 500 URLs take several minutes; 100 take about one.
- Why are priority and changefreq missing from my sitemap?
- Because Google ignores them: its sitemap documentation says so in as many words. Leaving them out keeps the file small. The sitemaps.org protocol makes both optional, so the file is still valid without them.
- Why was a page left out of my sitemap?
- The result lists every left-out URL under its reason: it redirects, returns an error, has a noindex, names a different canonical URL, is not an HTML page, or robots.txt blocks it. A page that never appears at all was not linked from any crawled page, was only linked with nofollow or by JavaScript, or sits beyond the URL limit.
- How many URLs can an XML sitemap have?
- Up to 50,000 URLs per file, and no more than 50 MB uncompressed. A bigger site uses several sitemaps and a sitemap index that lists them. This generator stops at 500 URLs, so its file is always well inside both limits.
- Where do I put the sitemap.xml file?
- In the root of your site, so it loads at https://yourdomain/sitemap.xml, on the same host and protocol as the URLs in it. Then add a Sitemap: line with its full address to robots.txt.
- How do I submit a sitemap to Google?
- In Google Search Console, open Sitemaps under Indexing, enter the sitemap's address and press Submit. The report then shows whether Google could read it and how many URLs it found. Submitting does not guarantee that Google crawls or indexes every URL.
- Do I need this if my site runs on WordPress or Shopify?
- Usually not. WordPress, Shopify, Wix and Squarespace generate a sitemap and update it as you publish, so submit that one. This generator is still a quick way to see which pages on a platform site are noindexed, redirected or canonicalised elsewhere.
- Does it respect robots.txt and nofollow?
- Yes. A path disallowed for Googlebot or for all crawlers is never fetched and is listed as blocked. If robots.txt answers with a server error, the crawl stops, because Google holds off in the same case. Links with rel="nofollow" are not followed.
From one page to your whole site
This writes a sitemap from a crawl of up to 500 URLs. Crawl Cove, the desktop crawler, checks the sitemap you already publish against a crawl of the site: indexable pages missing from it, listed URLs that redirect, fail, are noindexed or canonicalised elsewhere, lastmod dates that only record when the file was made, and a sitemap that robots.txt does not name. See check your sitemap against a full crawl or validate the file once it is live.
More free tools
More technical SEO tools →-
Website SEO Checker
Open tool → -
HTTP Header Checker
Open tool → -
Canonical Checker
Open tool →