This application performs various analyses on accident data using PySpark.
-
Install required dependencies: pip install -r requirements.txt
-
Place the data files in the
data/
directory. -
Adjust the
config/config.yaml
file paths according to your setup.
4.The results of the analyses will be stored in the output/results/
directory.
Run the application using spark-submit
:
spark-submit main.py config/config.yaml