IMDB Scrapy

Scrap best movies from IMDB using Scrapy

Installation

Use the package manager pip to install some packages needed.

git clone git@github.com:sustiono/imdb-scrapy.git
cd imdb-scrapy
pip3 install virtualenv
virtualenv .env
source .env/bin/activate
cd imdb
pip install -r requirements.txt

Usage

Choose one of the commands below to get the results in the desired format

scrapy crawl best_movies -o best_movies.csv
scrapy crawl best_movies -o best_movies.json
scrapy crawl best_movies -o best_movies.xml