/xandria-dist-scraper

A scraper to assist in extracting valuable information from internet resources to be hosted by the Xandria platform.

Primary LanguagePython

Xandria Distributed Scraper

The system covered in this repositry is with regards to the scraper component of Xandria.

alt text

Installation

Install requirements:

pip3 install -r requirements.txt

Execute

Run:

celery -A tasks worker
uvicorn main:app --reload

Visit: http://localhost:8000/