/BusinessDirectoryScraper

A web spider that crawls the SLEP business directory.

Primary LanguagePython

SLEP Web Scraper

Web spider to get all businesses listed under the Sarnia-Lambton Economic Partnership business directory.


Requirements:

  • Python 3
  • Scrapy 1.4

Instructions

  • git clone this repository
  • Install Requirements by doing pip install -r requirements.txt
  • cd into directory then run: scrapy crawl bd -o bd.json
  • Enjoy the data! This may take a while (It took me a whole episode of F.R.I.E.N.D.S. to finish)