-
Setup virtual env
virtualenv venv
-
Activate virtualenv
. venv/Scripts/activate
-
Install requirements
pip install -r requirementsnew.txt
-
Init scrapy (if not exist)
scrapy startproject scrapper
- Enter to the topic
cd kecelakaan
- Start the server
uvicorn main:app --reload
- Scrap first then get result
localhost:8000/scrap
- Classification model (naive bayes, logistic regression, etc) name must be model.pkl, location in classification folder
- Dataset for qe located in dataset/qe, the name must be look like the existing file
- The indicator must be defined manually in Severity.py
- Same as no 3, the indicator must be defined manually in Classification.py
- Scrapy URL must be look like the existing example