A multi-threaded spider module that could make spiders multi-threaded easily, helping crawl website faster. :zap:
Primary LanguagePythonMIT LicenseMIT