I'm scraping amazon products from a given list of products urls. I'm planning to use scraped data to seed a database of an e-commerce project that I'm currently working on.
- clone the repo
git clone https://github.com/cs-fedy/amazon-scraper
- change your current directory to scraper dir:
cd amazon-scraper
- install virtualenv using pip:
sudo pip install virtualenv
- create a new virtualenv:
virtualenv venv
- activate the virtualenv:
source venv/bin/activate
- install requirements:
pip install -r requirements.txt
- run the script and enjoy:
python scraper.py
- BeautifulSoup: Beautiful Soup is a library that makes it easy to scrape information from web pages. It sits atop an HTML or XML parser, providing Pythonic idioms for iterating, searching, and modifying the parse tree.
- requests: Requests is a simple, yet elegant, HTTP library.
created at 🌙 with 💻 and ❤ by f0ody
- Fedi abdouli - musixmatch database - fedi abdouli
- my twitter account FediAbdouli
- my instagram account f0odyy