This project analyzes traffic accidents using data from MongoDB connected with Mongo Spark Connector
- Ensure MongoDB is installed and running.
- Ensure Python is installed and running.
- Pyspark will be also installed
- pip install py4j==0.10.9
- pip install pyspark==3.1.2
- Install dependencies:
pip install -r requirements.txt
- Upload CSV data to MongoDB by running
python src/data_upload.py
. - Everything else will be done by running:
python src/analysis.py
. - For manualy fixing data run:
python src/NumbericType.py
.
- Ensure MongoDB connection strings are correct in the scripts.