/amazon-scraper

I'm scraping amazon products from a given list of products urls.

Primary LanguagePython

amazon product scraper:

I'm scraping amazon products from a given list of products urls. I'm planning to use scraped data to seed a database of an e-commerce project that I'm currently working on.

installation:

  1. clone the repo git clone https://github.com/cs-fedy/amazon-scraper
  2. change your current directory to scraper dir: cd amazon-scraper
  3. install virtualenv using pip: sudo pip install virtualenv
  4. create a new virtualenv: virtualenv venv
  5. activate the virtualenv: source venv/bin/activate
  6. install requirements: pip install -r requirements.txt
  7. run the script and enjoy: python scraper.py

used tools:

  1. BeautifulSoup: Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.
  2. requests: Requests is a simple, yet elegant, HTTP library.

Author:

created at 🌙 with 💻 and ❤ by f0ody