This package scrapes data from imot.bg
- Python Version > 3.8
- poetry https://python-poetry.org/docs/#installation
From your project directory install one of the two options (for Windows 10 use PowerShell):
- all dependencies
poetry install
- neglect development dependencies
poetry install --no-dev
You should now be able for find your virtual environment in the project
directory at the ./venv/
location.
Run poetry run pre-commit install
in the project directory once in
order for pre-commit hooks to work automatically at each git commit!
In the base directory execute poetry run pytest --cov tests/
.
- master - verified version of the code
- export to DB using SQLAlchemy
- loop over all result pages
- extract ad data by following each card's link
- add the following information:
- agency/broker
- home type (house)
- address
- days_online
- text
- floor & area