/rust-async-crawler

Just a clean boilerplate for crawling website with async-std, surf, scraper, colored.

Primary LanguageRustMIT LicenseMIT

rust-async-crawler

Just a clean boilerplate for crawling website with:

  • async-std
  • surf
  • scraper
  • colored

How to use?

git clone git@github.com:zzy/rust-async-crawler.git
cd rust-async-crawler
cargo build
cargo run

References