mrt-kousha/scrapy

In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framework.

scrapy

In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framework.

Follow wiki for more information and tutorials

Tor middleware instruction:

https://github.com/mrt-kousha/scrapy/wiki/Implement-Tor-middleware-for-anonymous-data-scraping

Ganjoor spider instruction:

https://github.com/mrt-kousha/scrapy/wiki/How-to-run-ganjoor-spider