A simple and extensible web crawler built on top of fetchbot.
Primary LanguageGoBSD 3-Clause "New" or "Revised" LicenseBSD-3-Clause