/Brainy-Quotes-Scrapy

Scrap 190k data from https://www.brainyquote.com/

Primary LanguagePython

Brainy-Quotes-Scrapy

Installation

Clone the project and open folder with vs code

  git clone https://github.com/samircd4/Brainy-Quotes-Scrapy.git

Go to terminal

  pip install -r requirements.txt

Go to Brainy-Quotes-Scrapy/quotes/spiders/config.py

  API = 'Your API KEY here' # Replace with your proxy api key

Run the script

  scrapy crawl -o quotes.csv

Or

  scrapy crawl -o quotes.json

Whatever output format you want either csv or json

Thank you

----Samir----