Technical SEO tool
Free Sitemap Generator
Free, no sign-up
What this sitemap generator builds
The result is a standard XML sitemap in the sitemaps.org 0.9 format: a UTF-8 file with one url entry per page, each holding the page's full address in loc. Every value is entity-escaped, so an address with an ampersand in its query string is written as the protocol requires. You can copy the file or download it as sitemap.xml and upload it to the root of your site.
A page gets a lastmod date only when your server sent a valid Last-Modified header for it. Nothing is guessed: a page without that header has no lastmod, rather than today's date or the date of the crawl. Google says it uses lastmod only when the value is consistently and verifiably accurate, so a missing date is better than a made-up one.
The file has no priority or changefreq tags. Google says it ignores both, and inventing values for them would only add noise.
How the crawl finds your pages
The generator starts at the address you enter and follows the links on each page, breadth first, so the pages closest to your start page come first. It stays on your site: the www and bare forms of your domain count as one site, but other subdomains and other sites are never crawled, because a sitemap may only list URLs from a single host.
- robots.txt is read before any page, and its rules are obeyed for our crawler (user agent token AzuqeTools), falling back to the rules for every crawler.
- Requests are spaced out evenly, at most 5 a second with 2 at a time, so the crawl never floods your server.
- If your robots.txt sets a Crawl-delay for our crawler or for every crawler, the crawl waits that long between pages, up to 10 seconds, and the result says so. Google ignores Crawl-delay, but we follow it.
- If your site answers with a rate limit or a block, or with several server errors in a row, the crawl stops instead of pushing on.
- A redirect to another site is noted and never followed, so the crawl never touches pages that are not yours.
One run keeps up to 500 pages and crawls for about 2 minutes. When a site is larger than that, the sitemap covers the first pages found and the result says so plainly, so you never mistake a partial file for the whole site.
Which pages the sitemap leaves out, and why
Google asks for the canonical, indexable version of each page in a sitemap. So the generator leaves a page out when listing it would send search engines mixed signals, and counts each one by reason:
| Reason | What it means |
|---|---|
| Blocked by robots.txt | Your robots.txt disallows the URL for crawlers, so it was not fetched. |
| Marked noindex | A robots meta tag or an X-Robots-Tag header asks search engines not to index the page. |
| Canonical points elsewhere | The page names another URL as its canonical version; that URL is crawled instead. |
| Redirects off the site | The URL redirects to another site, which a sitemap for this site cannot list. |
| Not a web page | The URL answered with a PDF, an image or another file that is not HTML. |
| Error or not found | The URL answered with an error status, gave no answer, or showed a 'not found' page. |
| Repeating date pattern | One of many URLs that differ only by a date, such as calendar pages. Three are crawled and the rest are skipped. Plain numbers, such as product ids, are never treated this way. |
| Same page, other query strings | More than five addresses for one page that differ only in their query string, such as sort orders and filters. A query that names a page by its id, such as ?p=123, counts as its own page. |
| Path too deep or address too long | A path with more than 12 folders, or longer than 1,024 characters, usually comes from a loop of relative links. |
| Redirects to itself | The address redirects to its own address once www and the scheme are folded together. |
Addresses that differ only by a #fragment, tracking parameters such as utm_source, gclid or fbclid, session ids, or the order of their query parameters are treated as one page, so the sitemap lists each page once.
What to do with your sitemap.xml
- Check the list of skipped URLs. A page you expected in the sitemap that shows up as noindex or blocked usually points to a setting you did not mean to leave on.
- Upload the file to the root of your site, so it is reachable at an address such as https://example.com/sitemap.xml.
- Add a line such as Sitemap: https://example.com/sitemap.xml anywhere in your robots.txt, so every crawler can find it.
- Submit the sitemap in Google Search Console. Google treats a sitemap as a hint, so it is not a promise that every page will be indexed.
A sitemap made by one crawl goes stale as you publish and remove pages. Run the generator again after larger changes, or use a sitemap your site builder or CMS keeps up to date and check it with the sitemap checker.
Where these sitemap rules come from
Questions about generating a sitemap
How do I create a sitemap.xml for my website?
Enter your site's address and run the generator. It crawls your pages by following links, obeys your robots.txt, and builds a sitemap.xml of the indexable pages it finds. Copy the file or download it, upload it to the root of your site, and add a Sitemap: line to robots.txt.
How many pages can the free sitemap generator crawl?
One run keeps up to 500 pages and crawls for about 2 minutes, at most 5 requests a second. On a larger site the sitemap covers the first pages found, and the result says so. The sitemap protocol allows up to 50,000 URLs per file.
Why are some of my pages missing from the sitemap?
The result lists every URL it left out with the reason: blocked by robots.txt, marked noindex, a canonical that points elsewhere, a redirect to another site, a file that is not a web page, an error, one of many calendar pages that differ only by a date, or one of many query-string versions of one page. Pages that nothing links to cannot be found by a crawl at all.
Does the sitemap include lastmod dates?
Only where your server sent a valid Last-Modified header for the page. A page without one gets no lastmod rather than a guessed date. Google says it uses lastmod only when it is consistently accurate.
Will the crawl slow down or harm my site?
No. Requests are spaced out evenly at 5 a second at most, with 2 at a time, robots.txt is obeyed, including any Crawl-delay it sets (up to 10 seconds), and the crawl stops if your site answers with a rate limit, a block or repeated server errors. It reads pages only and never submits forms.
Can I run two crawls at once?
No. Each visitor can have one crawl going at a time. Starting another while the first runs tells you to wait for it to finish, and does not use up one of your free runs.
More free tools
See all free tools- Sitemap CheckerFinds a site's sitemaps, validates the XML against the sitemap protocol, checks child sitemaps and spot-checks listed URLs for errors, redirects and noindex.
- Sitemap URL ExtractorPulls every URL from a sitemap or a whole site with its lastmod date, following sitemap indexes, and exports the list to CSV or TXT.
- Robots.txt TesterTests whether a site's robots.txt, or one you paste, lets Googlebot, Bingbot, AI crawlers or any user agent fetch each URL, and shows the line that decided.
Keep your sitemap right as your site changes
This tool builds a sitemap from one crawl of your site. Azuqe crawls your whole site on a schedule, audits every page it finds, and flags the pages that drop out of the index, redirect, error or contradict your sitemap, with the fixes listed in order of impact.
Free trial on your first site · Cancel any time