🕷️ Free Scrapy Tutorials To Learn Web Scraping
Source code developed in https://scrapinghub.com/learn-scrapy
Use the package manager poetry to install dependencies.
poetry install
# quotes
poetry run scrapy runspider quotes.py -o quotes.json
# authors
poetry run scrapy runspider authors.py -o authors.json
# quotes scroll
poetry run scrapy runspider quotes_scroll.py -o quotes_scroll.json
# login
poetry run scrapy runspider login.py -o login.json
# cover scrape (download images)
cd scrape_cover/
poetry run scrapy crawl bookstoscrape
# splash (JS)
docker run -p 8050:8050 -d scrapinghub/splash
cd splash_based_project/
poetry run scrapy crawl quotejs