Create an XML Sitemap with Live Crawl Progress
Crawl your website's internal HTML links and generate a sitemap.xml file with optional metadata such as lastmod, changefreq, and priority.
What Is an XML Sitemap and Why Does It Matter?
An XML sitemap is a roadmap for search engines — it tells them which pages exist and when they were last changed.
XML Is for Search Engines
Unlike HTML sitemaps (which help visitors navigate), an XML sitemap is designed for crawlers like Googlebot. It lists every important URL with optional metadata like last modified date, change frequency, and priority.
Why Submit One?
Submitting an XML sitemap helps search engines discover pages they might miss through normal crawling — especially on new, large, or recently redesigned websites.
How This Tool Works
Our crawler starts from your URL, follows every internal HTML link it finds, and formats the discovered pages into a valid sitemap.xml file — with live progress updates as it works.
Discovery, Not Indexing
An XML sitemap helps search engines discover your pages, but does not guarantee indexing. Indexing depends on content quality, robots.txt rules, and the search engine's own algorithms.
XML Sitemap Generator
Maximum 250 pages per crawl.
Applies the selected date to every generated URL. Does not detect each page's actual modification date.
Optional legacy sitemap fields. lastmod is most useful when it reflects the page's real update date. changefreq and priority are hints — search engines may ignore them.
Privacy note: your website is fetched from our server during the crawl. Crawled URLs are used to generate the sitemap and are not stored by the tool after the request completes.
What This XML Sitemap Generator Checks
The crawler follows internal links and builds a sitemap. Here's what it actually does.
Live Crawling
Follows internal HTML links starting from your URL and streams progress updates in real time.
Valid XML Output
Generates a sitemap.xml file that follows the official sitemaps.org protocol.
lastmod Metadata
Optionally includes the last modified date (today, custom, or omitted) for each URL.
changefreq & Priority
Optionally adds change frequency and priority hints — search engines may ignore these legacy fields.
Copy or Download
Copy the XML to clipboard or download the ready-to-upload sitemap.xml file.
Customizable Limits
Choose 50, 100 or 250 pages per crawl — the maximum for a single crawl.
Honest by Design
This tool crawls your website and generates an XML sitemap. Here is exactly what it does and does not do:
- ✓ Crawls publicly accessible HTML pages and follows internal links from your starting URL.
- ✓ Does not bypass login-protected pages and does not execute JavaScript-rendered navigation.
- ✓ Generates a valid sitemap.xml — you still upload it and submit it to search engines yourself.
- ✓ Does not guarantee indexing — a sitemap is a discovery tool, not an indexing guarantee.
- ✓ Does not generate image or video sitemap metadata — those require separate specialized files.
This tool does
- Crawl public HTML pages
- Follow internal links from your starting URL
- Generate valid XML sitemap format
- Provide optional lastmod, changefreq, priority fields
- Create downloadable sitemap.xml file
- Show real-time crawl progress
This tool does not
- Crawl login-protected pages
- Render JavaScript navigation or SPAs
- Submit sitemap to Google/Bing automatically
- Guarantee search engine indexing
- Guarantee improved rankings
- Generate image or video sitemap metadata
Want to Understand XML Sitemaps & Improve Website Indexing?
We published a complete beginner-friendly guide explaining what an XML sitemap is, how search engines use it, why it's important for SEO, sitemap best practices, common mistakes to avoid, and how to generate an XML sitemap for any website.
📘 Read Full XML Sitemap Guide →How to Generate and Use an XML Sitemap
Four steps from crawling to submitting your sitemap to search engines.
Enter URL & Settings
Paste your website URL and customize crawl depth, last modified date, and optional fields.
Start the Live Crawl
Click Generate and watch real-time progress as the crawler discovers your pages.
Review & Download
When the crawl finishes, preview the XML and download the sitemap.xml file.
Upload & Submit
Upload sitemap.xml to your website root and submit its URL to Google Search Console or Bing Webmaster Tools.
Common Issues and What They Mean
If the crawl fails or the sitemap looks wrong, here's what to check.
No Pages Found
CRAWL FAILEDThe crawler couldn't access your starting URL.
Solution: Check that the URL is public and accessible. If your site blocks crawlers, the tool cannot access it.
Too Few Pages
LIMITED CRAWLThe sitemap contains fewer pages than expected.
Solution: Increase the crawl limit, or check that your site's internal linking is complete. JavaScript-rendered pages won't be discovered.
Missing Metadata
XML SETTINGSXML sitemap lacks last modified dates or priority.
Solution: Select a custom date if you know the real update dates. Remember these fields are optional.
Timeout Error
SERVER LIMITThe crawl took too long and was interrupted.
Solution: Reduce the page limit to 50 or 100. The tool returns the pages discovered so far when the time limit is reached.
Site Blocks the Crawler
ACCESS BLOCKEDSome hosts or firewalls block automated crawlers.
Solution: Check that your hosting or a security plugin is not blocking crawler user-agents.
JavaScript Pages Missing
JS LIMITPages that only exist via JavaScript navigation are not discovered.
Solution: Make sure important pages have regular HTML links (<a href>) pointing to them.
When to Generate an XML Sitemap — and What to Do Next
Use the generator when you need to create or update your sitemap.xml file.
sitemap.xml to your root directory and submit to Google Search Console.XML Sitemap Generator FAQs
Answers based strictly on what this tool does and how it works.
Where do I upload the sitemap.xml file?
Upload it to your website's root directory so it's accessible at https://yourdomain.com/sitemap.xml. Most hosting control panels have a file manager for this.
What do I do after uploading the sitemap?
Submit the URL (e.g., https://yourdomain.com/sitemap.xml) to Google Search Console and Bing Webmaster Tools. This tells them where to find it.
What are changefreq and priority?
Optional legacy XML fields. changefreq hints how often a page changes. priority hints relative importance within your site (0.0 to 1.0). Search engines may ignore both.
Why doesn't the crawler find all my pages?
The crawler only follows links it finds in HTML. Pages behind JavaScript rendering, login walls, or with no internal links won't be discovered.
Does this tool create image or video sitemaps?
No. Image and video sitemaps require specific metadata that can't be reliably crawled automatically. Use Google's official guides to create those manually.
How often should I regenerate my sitemap?
Regenerate when you add or remove important URLs or make significant changes to your website. If your site changes frequently, regular regeneration helps keep the sitemap current.
Will this guarantee all pages get indexed?
No. Sitemaps help search engines discover pages, but indexing depends on content quality, robots.txt rules, and other factors. A sitemap is a discovery tool, not an indexing guarantee.
Is my website data sent to your server?
Yes. The crawler fetches your website from our server to discover pages. The tool does not intentionally store the crawled URLs after the request.