Live

Sitemap Diff — URL inventory with change detection

Extract every URL from a website's sitemaps, and find out what changed since your last check: pages added, pages removed, pages updated. One run gives you the full inventory; scheduled runs give you a change feed for any site on the internet.

What it does

Discovers sitemaps automatically from robots.txt, falling back to /sitemap.xml and common index paths
Follows sitemap indexes recursively, including gzipped (.xml.gz) files
Extracts every URL with its lastmod date
Snapshots per domain, then reports added / removed / changed URLs on the next run
No browser, no proxies, no login — it reads the same files sites publish for Google

Use cases

SEO monitoring — catch when a competitor publishes new landing pages, kills old ones, or refreshes content
RAG and AI pipelines — keep a vector index fresh by re-crawling only the URLs that changed, not the whole site
Content watch — see when a publisher, government site, or docs portal adds pages on a topic
Site audits — instant URL inventory for any domain, exportable as JSON or CSV

Pricing

Event	Price (USD)
Run start	$0.0001
Per 1,000 URLs processed	$0.01
Diff computed	$0.02
API call (standby)	$0.01

A 50,000-URL site costs about $0.52 per monitored check. The live price on the Apify page is authoritative.

Runs on Apify — free account, pay per event, schedule it or call it as a live endpoint from your code and agents.

Run on Apify →