The project contains 3 example scrapy projects written in Python that demonstrate 3 concepts.
- Handling single request & response by extracting a city's weather from a weather site - weather.com
- Handling multiple request & response by extracting book details from a dummy online book store - bookstoscrape
- Image scraping - imagescraper
To run these examples, Scrapy needs to be installed. Scrapy can be installed either through anaconda or pip.
conda install -c conda-forge scrapy
or
pip install Scrapy
For installing on other OS and any other installation queries, please click here.
Commands to run individual examples are provided in dedicated README.md files inside these projects.