Sitemap generator
Crawl your website once and get an XML sitemap for search engines, an HTML sitemap page for visitors and a TXT list of URLs. Redirects, errors, noindex pages and duplicates are left out, each with the reason.
- Reads and obeys robots.txt
- XML, HTML and TXT from one crawl
- Up to 500 pages per crawl
URLs in the sitemap
Enter a URL to start
- SiteWaiting for inputAfter redirects
- robots.txt—Rules obeyed
- Crawl—HTML links followed
- Sitemap—Indexable pages only
Your sitemap
Enter your website above to crawl it. The sitemap in XML, HTML and TXT, the options and every checked URL, with the reason it was included or left out, appear here.
Fair-use limit for each visitor IP address: 20 crawls and 1,500 pages per hour, 5,000 pages per day. Pages are read up to 2 MB each.
Three sitemap formats
A sitemap lists the pages you want found. XML and TXT files are read by search engines; an HTML sitemap is a page that people read.
XML for search engines
The standard format. Besides each URL it can carry lastmod, the date of the last significant change, which Google uses when it is accurate.
TXT, the simplest file
One full URL per line, UTF-8, nothing else. Google accepts it like XML, up to 50,000 URLs or 50 MB per file.
HTML for visitors
A normal page of links, grouped by section. It helps people find pages and adds internal links; it is not submitted anywhere.
A hint, not a command
Search engines decide what to crawl and index. Only canonical, indexable URLs belong in a sitemap, and good internal links still matter most.
XML vs HTML vs TXT
Which format to use, and where each one goes.
| Format | Read by | What it holds | Where it goes | |
|---|---|---|---|---|
sitemap.xml |
Search engines | Each URL, with an optional lastmod date | Site root, then Search Console or robots.txt | Supported |
sitemap.txt |
Search engines | Only URLs, one per line | Site root, then Search Console or robots.txt | Supported |
HTML sitemap |
Visitors | Page titles as links, grouped by section | A page such as /sitemap/, linked from the footer | Read as a normal page |
How to use this tool
From your homepage to a sitemap on your site.
Enter your homepage
The tool follows redirects to your real site address and reads robots.txt first.
Watch the crawl
Pages are fetched five at a time, following the links in their HTML, up to the limit you chose.
Pick a format
XML, HTML or TXT. Switching rebuilds the output at once, without crawling again.
Upload or paste it
Upload sitemap.xml or sitemap.txt to your site root, or paste the HTML into a page.
What this tool does, and what it doesn't
A plain list, so you know exactly what to expect.
This tool does
- Crawl public HTML pages on one host
- Obey robots.txt and noindex
- Leave out redirects and duplicates
- Build XML, HTML and TXT sitemaps
- Show why each URL was left out
- Use real lastmod dates it finds
This tool does not
- Run JavaScript or log in
- Submit the sitemap for you
- Update the file when you add pages
- Make image, video or news sitemaps
- Guarantee indexing or rankings
- Store your URLs or pages
Where your data goes
Our server fetches robots.txt and your pages, identifying itself as AllInOneToolsSitemapBot, and returns the results to your browser, where all three sitemaps are built. URLs and page content are not saved. robots.txt is cached for 10 minutes, and fair-use counters use a hashed IP address. Details are in our privacy policy.
Why your results might look unexpected
The six situations people run into most, and what each one means.
Only one page found
The links are added by JavaScript, or they point to another host, such as www.example.com.
Many redirects
Internal links use http, a missing trailing slash or an old URL. Link straight to the final URL.
Pages excluded as noindex
A robots meta tag or X-Robots-Tag header asks search engines not to index them.
Canonical points elsewhere
The page names another URL as the main version, often for duplicates or parameters.
Blocked or 403 errors
A firewall or bot protection blocks crawlers. Allow the tool, or crawl a staging copy.
Odd link text in the HTML sitemap
The page has no title tag, or a title shared by many pages. Fix the titles, or use URL paths.
Questions about sitemaps
What is the difference between XML, HTML and TXT sitemaps?
An XML sitemap is a file for search engines and can carry a lastmod date for each URL. A TXT sitemap is the simplest file for search engines: one URL per line and nothing else. An HTML sitemap is an ordinary page of links for visitors. Google accepts XML and TXT sitemaps and has no preference between them; an HTML sitemap is not submitted anywhere, it is just a page on your site.
Where do I upload sitemap.xml or sitemap.txt?
Upload it to the root folder of your website, so it opens at https://example.com/sitemap.xml or https://example.com/sitemap.txt, using your hosting file manager or FTP. Then add it in the Sitemaps report of Google Search Console, or add a line such as Sitemap: https://example.com/sitemap.xml to robots.txt. On WordPress, check first whether you already have one: WordPress 5.5 and later create wp-sitemap.xml, and SEO plugins such as Yoast SEO or Rank Math make their own. An uploaded file does not update itself when you add pages.
How do I add the HTML sitemap to my website?
Choose "Snippet for a page", copy it, create a page such as /sitemap/ and paste it into a Custom HTML block (in WordPress) or your page editor. Then link to that page from your footer. The full HTML file is for sites without a page editor: upload it as sitemap.html. Remember to update the page when you add or remove important pages.
Why are some pages left out of the sitemap?
A sitemap should only list the URLs you want in search results. The tool leaves out redirects, pages with errors, pages marked noindex, pages whose canonical tag points to another URL, files that are not HTML and URLs blocked by robots.txt. Each one is listed in the report with the reason, so you can fix the page or the link to it.
Should I set lastmod, changefreq and priority?
Only lastmod matters, and only when it is accurate. With "Date found on the page", the tool uses the dateModified value in structured data, the article:modified_time or og:updated_time meta tag, or a real Last-Modified header. Giving every page today's date is worse than leaving it out, because Google only uses lastmod when it is consistently accurate. Google ignores changefreq and priority, so both are off by default. TXT and HTML sitemaps have no dates at all.
Why doesn't the crawler find all my pages?
It follows links in the HTML, like a search engine that does not run JavaScript. Pages that are only reachable through JavaScript, pages no other page links to, pages behind a login and links to another host, such as www versus non-www, are not found. URLs with ?parameters are skipped unless you include them, and one crawl checks up to 500 pages.
Is my website data sent to your server?
Yes. To crawl your site, our server fetches its pages and robots.txt. The server returns the results to your browser and does not save the URLs or page content. robots.txt is cached for 10 minutes, and fair-use counters are kept under a hashed version of your IP address. The sitemap itself is built in your browser, as described in our privacy policy.