/reviews-scraper

Scrape Reviews from sites like Google, Trip advisor etc

Primary LanguagePythonApache License 2.0Apache-2.0

Reviews scraper

This repo contains scrapers to scrape reviews from Google, TripAdvisor etc. You can find the domain specific reviews under the following URLs:

  1. Google
  2. Trip Advisor - TBD

I am using Google Chrome browser to load the page and do the scrolling. So, you need to have Google Chrome web driver in your path in order to make this scraper work. Make sure you download the version same as your Chrome browser.

I am using Splinter and Beautifulsoup to extract and parsing the HTML respectively.

Webdriver security issue on MacOS

Mac will throw a security error while running chromedriver. To make the chromedriver binary file trusted run the following command:

$ xattr -d com.apple.quarantine <path to chromedriver>