cuimuxi/dirbot

Scrapy project to scrape public web directories (educational)

Python