My first Python project. This web scraping project scrapes quotes from BrainyQuote.com. The user can specify a quote category and the number of quotes they'd like to fetch. The scraped data is written to text files in the src/Quotes directory.
See an old demo: https://www.youtube.com/watch?v=5dCThWMT50o
- Clone this repo and change into the drivers directory
git clone https://github.com/Tymotex/Quote-scraping.git
- Find out your chrome version. Type in the URL bar: chrome://version/
- The project currently has chromedriver version 80.0.3987.106. If this doesn't match your current chrome version, download a suitable chromedriver version from https://chromedriver.chromium.org/downloads. Place the driver inside the drivers directory, named as 'chromedriver': Quote-Scraper/src/drivers/chromedriver.
- Navigate to the project root folder and install all dependencies:
pip3 install -r requirements.txt
- Navigate to the src directory and run QuoteScraper.py
python3 QuoteScraper.py
Working in Linux Ubuntu. Not well tested in Windows or MacOS. The only part that may break is how the paths have been constructed.