amazoncrawler - Crawls bestsellers in books on Amazon India and US websites.

Amazon.in data: https://bit.ly/amazon_in_book_data

Amazon.com data: https://bit.ly/amazon_com_book_data

Description

Web crawler written using Scrapy. It compiles the bestsellers in a single csv file. Domain usage depends on the parameter supplied. Default domain is amazon.in

Installation

pip install scrapy

Usage

To view the items only: scrapy crawl amazon [-a country=us ]

To save the items in a csv file: scrapy crawl amazon [-a country=us ] -o $file.csv

Examples

scrapy crawl amazon -o output.csv
scrapy crawl amazon -a country=us -o output.csv