XML sitemap generator
Crawl your website and get a sitemap.xml with only the pages that belong in it. Redirects, errors, noindex pages and duplicates are left out, and each one is listed with the reason.
- Reads and obeys robots.txt
- Real lastmod dates when pages have them
- Up to 500 pages per crawl
URLs in the sitemap
Enter a URL to start
- SiteWaiting for inputAfter redirects
- robots.txt—Rules obeyed
- Crawl—HTML links followed
- Sitemap—Indexable pages only
Your sitemap
Enter your website above to crawl it. The sitemap, the options and every checked URL, with the reason it was included or left out, appear here.
Fair-use limit for each visitor IP address: 20 crawls and 1,500 pages per hour, 5,000 pages per day. Pages are read up to 2 MB each.
What an XML sitemap does
A sitemap is a list of the pages you want search engines to know about. It helps them find pages; it does not make them index or rank anything.
A list for crawlers
Unlike an HTML sitemap for visitors, sitemap.xml is read by Googlebot and Bingbot to discover URLs, especially on new, large or poorly linked sites.
Only canonical, indexable URLs
List the version of each page you want in search results. Redirects, errors, noindex pages and duplicates send mixed signals.
lastmod is the date that matters
Google uses lastmod when it is consistently accurate, and ignores changefreq and priority entirely.
A hint, not a command
Search engines decide what to crawl and index. Good internal links still matter more than any sitemap.
The tags in a sitemap
What each one means in the sitemap protocol, and what Google does with it.
| Tag | Status | What it holds | What Google does |
|---|---|---|---|
<urlset> |
Required | Wraps the file and names the sitemap protocol. | Reads it as a sitemap. |
<url> |
Required | One entry per page. | Up to 50,000 per file. |
<loc> |
Required | The full, absolute URL of the page, with & written as &. | Uses it to find the page. List the canonical version only. |
<lastmod> |
Optional | Date of the last significant change, such as 2026-10-15. | Used when it is consistently accurate. |
<changefreq> |
Optional | How often the page changes: always to never. | Ignored. |
<priority> |
Optional | Importance from 0.0 to 1.0 relative to your other pages. | Ignored. |
How to use this tool
From your homepage to a submitted sitemap.
Enter your homepage
The tool follows redirects to your real site address and reads robots.txt first.
Watch the crawl
Pages are fetched five at a time, following the links in their HTML, up to the limit you chose.
Check what was left out
Redirects, errors, noindex and canonicalized pages are listed with the reason.
Download and submit
Upload sitemap.xml to your site root, then add it in Search Console or robots.txt.
What this tool does, and what it doesn't
A plain list, so you know exactly what to expect.
This tool does
- Crawl public HTML pages on one host
- Obey robots.txt and noindex
- Leave out redirects and duplicates
- Use real lastmod dates it finds
- Show why each URL was left out
- Export sitemap.xml and a CSV
This tool does not
- Run JavaScript or log in
- Submit the sitemap for you
- Update the file when you add pages
- Make image, video or news sitemaps
- Guarantee indexing or rankings
- Store your URLs or pages
Where your data goes
Our server fetches robots.txt and your pages, identifying itself as AllInOneToolsSitemapBot, and returns the results to your browser, where the sitemap is built. URLs and page content are not saved. robots.txt is cached for 10 minutes, and fair-use counters use a hashed IP address. Details are in our privacy policy.
Step-by-step guide by Bhavin J. Sheth.
Why your results might look unexpected
The six situations people run into most, and what each one means.
Only one page found
The links are added by JavaScript, or they point to another host, such as www.example.com.
Many redirects
Internal links use http, a missing trailing slash or an old URL. Link straight to the final URL.
Pages excluded as noindex
A robots meta tag or X-Robots-Tag header asks search engines not to index them.
Canonical points elsewhere
The page names another URL as the main version, often for duplicates or parameters.
Blocked or 403 errors
A firewall or bot protection blocks crawlers. Allow the tool, or crawl a staging copy.
Crawl stopped at the limit
More pages were waiting in the queue. Raise the limit or start from a section page.
Questions about XML sitemaps
Where do I upload the sitemap.xml file?
Upload it to the root folder of your website, so it opens at https://example.com/sitemap.xml, using your hosting file manager or FTP. On WordPress, check first whether you already have one: WordPress 5.5 and later create wp-sitemap.xml, and SEO plugins such as Yoast SEO or Rank Math make their own. Keep one sitemap per site, and remember that an uploaded file does not update itself when you add pages.
How do I submit the sitemap to Google?
Add it in the Sitemaps report of Google Search Console, or add a line such as Sitemap: https://example.com/sitemap.xml anywhere in your robots.txt file. Bing Webmaster Tools accepts sitemaps too. Google retired its sitemap ping URL in 2023, so pinging no longer works. A sitemap is a hint: it helps discovery, but it does not guarantee crawling or indexing.
Why are some pages left out of the sitemap?
A sitemap should only list the URLs you want in search results. The tool leaves out redirects, pages with errors, pages marked noindex, pages whose canonical tag points to another URL, files that are not HTML and URLs blocked by robots.txt. Each one is listed in the report with the reason, so you can fix the page or the link to it.
Where does the lastmod date come from?
With "Date found on the page", the tool uses the dateModified value in the page's structured data, or the article:modified_time or og:updated_time meta tag, and otherwise the Last-Modified header when the server sends a real date. Pages without a date get no lastmod. Google only uses lastmod when it is consistently accurate, so giving every page today's date is worse than leaving it out.
Should I add changefreq and priority?
They are optional, and Google ignores both. They remain valid in the sitemap protocol, so you can add them for other tools, but they do not make pages crawl faster or rank higher. Both are off by default.
Why doesn't the crawler find all my pages?
It follows links in the HTML, like a search engine that does not run JavaScript. Pages that are only reachable through JavaScript, pages no other page links to, pages behind a login and links to another host, such as www versus non-www, are not found. URLs with ?parameters are skipped unless you include them, and one crawl checks up to 500 pages.
Is my website data sent to your server?
Yes. To crawl your site, our server fetches its pages and robots.txt. The server returns the results to your browser and does not save the URLs or page content. robots.txt is cached for 10 minutes, and fair-use counters are kept under a hashed version of your IP address. The sitemap itself is built in your browser, as described in our privacy policy.