A very simple and flexible web crawler, support multiple run modes.
Primary LanguageGoApache License 2.0Apache-2.0