/Scrapy-projects

This is a collection of some of my web scraping projects in scrapy framework

Primary LanguagePythonMIT LicenseMIT

Scrapy based Projects

These are collection of some of my web scraping projects with scrapy. Feel free to use them, modify them and suggest modifications.

Requirements:

  1. Python 3

  2. Scrapy framework

    pip3 install scrapy

Usage:

  1. cd <project directory>
  2. scrapy crawl <spider name> -o <output file name>.<jl/json/csv>