akimikano/kijiji_scraper

Kijiji website scraping

Small project scraping apartments from website and saving in DB

Launching

Use docker-compose command to launch project

docker-compose up --build

If error occured try to restart container "app"

docker restart app

If everything is ok you will see according logs in every step You can test script with Sqlite and Postgresql. There are two DATABASE_URL variables in settings.py. Now Postgresql is commented.

Libraries

Used libraries:

1. Selenium for scraping
2. Sqlalchemy for db queries