/web_scraper_examples

Contains some simple web scrapers for my own future reference

Primary LanguagePython

install the required libraries:

pip install beatifulsoup4
pip install selenium

download the ChromeDriver

Download the appropriate version here and place the executable chromedriver.exe in the same directory as the get_soup.py script.

ChromeDriver, invoked by Selenium, essentially makes content dynamically generated by JS scrape-able (by executing JavaScript as if visiting the target URL in Chrome).