/Venture_Supply_Product_Scraper

A product scraper used to scrape down products for VentureSupply

Primary LanguagePython

Automate Product Scraping from VentureSupply's Vendor Sites

A simple web scraper, written using scrapy.
Visits vendors sites, scrapes down all of their product information, and prepares a CSV file for upload into shopify.

Supports:

Installation

conda install -c conda-forge scrapy
pip install scrapy

Running

scrapy runspider clarkeSpider.py -o clarkeSite.json

For handy debug information, see this guide