wei-wang-develop/dirbot

Scrapy project to scrape public web directories (educational) [DEPRECATED]

Python