ReviewScraper

Scrape the product reviews and store them in a database.

General Information

This project scrapes the reviews of the products from Flipkart and stores them in a database to avoid scraping for the same product at a later point in time.

Clone this repo using

git clone https://github.com/Anil-45/ReviewScraper.git

Install the required modules using

pip install -r Requirements.txt

To use SQL database, generate a config file using generate_config.py.

Open generate_config.py and edit host, username and password.

config_file.set(DATABASE, HOST, "127.0.0.1")
config_file.set(DATABASE, USERNAME, "root")
config_file.set(DATABASE, PASSWORD, "root")

Once you are done editing, run:

python generate_config.py

Alternatively, you can also edit config.ini.

You can run the project without a database also, but the results for the products will always be scraped.

Run the app:

python app.py

You can find all the logs in .log files

This project is available under the MIT.