This scraping tool is implemented using scrapy to scrape divar real estate adverts.
- Install scrapy using
pip install scrapy
- Change
limit
indivar_spider.py
to which limit you want (number of adverts that is going to be crawled). - run the scrapy using
scrapy crawl -O divar.json
- You can see the result in the divar.json file.