crawl-site
There are 3 repositories under crawl-site topic.
viasite/site-audit-seo
Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx
CatalystsReachOut/webservice-seo-audit
Crawl the site, examine all pages, and view the public reports in the browser using the web service and CLI tool for SEO site audit. Also output to Google Drive, JSON, CSV, XLS, and the console.
hzuhdi/Web-Crawler
✨ Java Web Crawler with TDD Approach