/web-crawler

Rust Web Crawler that finds every page, image, and script on a website (and downloads it)

Primary LanguageRust

Watchers