/xml-sitemap-scraper

A robust and simple Python script that scrapes XML sitemaps and returns all URLs contained with <loc> tags, as per the Sitemaps.org Protocol.

Primary LanguagePython

Stargazers