Python Web Scraping

Introduction

This code has been written using Python and BeautifulSoup. Important to note that the code has been tested on ONLY Linux-based OSs, and may not work on Windows. Executing this code will scrape the details about top 100 bestseller books on amazon.com and amazon.in. Details include Name, url, author, price, number of ratings and average rating of the book. Output will be stored in a spreadsheet stored in current directory

Running the program

  • Run the following code on terminal
    • pip3 install beautifulsoup4
    • pip3 install requests
  • Execute the code by using python3 com_bestseller.py and python3 in_bestseller.py in the current directory.