Spider built with Scrapy. Scrapes emmi.rs and gets all available products. Option to send e-mail and sms message when scraping is finished. Uses rotating user agents.
Also included csv, json and xml files that Scrapy can generate.
git clone https://github.com/Lazar-T/E-Commerce-scraper
cd E-Commerce-scraper
scrapy crawl emi
For e-mail and sms notification emmiScraper/spiders/emmi.py file should be updated. Methods that require modifications are: send_email and send_sms.
Note: For sending sms message using Twilio, free registration on twilio.com would be nesesarry.