/python-scraping

Updated how-to on scraping with Python for NICAR18 and beyond

Primary LanguageJupyter Notebook

Scraping with Python

Alex Richards (@alexrichards), NerdWallet

We'll use a few helpful Python packages to create a web scraper.

This session will cover:

  • Why you'd ever want to do this
  • Fetching web pages with Python
  • Navigating HTML
  • Structuring scraped data and writing it to a CSV

Software requirements:

(If you already have Python 3, pip install -r requirements.txt after downloading this repository for everything you need.)

Questions? Concerns? Send Alex a note (arichards@nerdwallet.com) or DM Alex on Twitter.

Struggling with installation? Try this updated guide for Windows and OS X.

Further reading and more tutorials: