Multi-threaded Web crawler with support for custom fetching and persisting logic
Primary LanguageRust