Daryaggg/ur_parts

UrParts scraper

Service for scraping www.urparts.com website and build API for fetching data.

Quick start

Use docker-compose to start the service.

docker-compose up

Stages

1. Postgres database start up
2. Run pytest on scraper
3. Starting the scraper if there is no data in the database yet
4. Run webapp FastAPI on http://127.0.0.1:8000/ur_parts/

Run tests

bash tests/run_tests.sh

Tech

• Python 3.8
• requests
• BeautifulSoup4
• psycopg2
• Encode Databases