/rust-amazon-topsellers

This program will scrape the title, link, rating, and number of comments from the Amazon bestsellers page and save extracted data to a bestsellers.csv file.

Primary LanguageRust

Amazon bestsellers demo

This program will scrape the title, link, rating, and number of comments from the Amazon bestsellers page and save extracted data to a bestsellers.csv file.

It uses a Selenium / WebDriver method of extraction.

Try it out!

  1. Install Rust
  2. Install geckodriver:
$ cargo install geckodriver
  1. Optionally, on X11 you can install virtual framebuffer Xvfb to hide the puppet browser:
# On Debian/Ubuntu
$ sudo apt install xvfb
# On Fedora
$ yum install xorg-x11-server-Xvfb
  1. Optionally, change the default setting in the config.toml file.
  2. Run the app:
# This will start a virtual frame buffer :99, start geckodriver, compile, and run the scraper
$ ./scripts/start.sh

After the extraction's finished you'll find all extracted data in the bestsellers.csv file.