/spark_ml

Creating a machine learning model in a distributed computing environment with PySpark.

Primary LanguageJupyter NotebookMIT LicenseMIT

Spark ML

PySpark is a powerful tool not only for distributed computing, but also for applying machine learning models to distributed datasets. This repository contains a Jupyter notebook where a decision tree classifier was applied to a cleaned version of the hotel booking demand dataset, made by me, which is available here. Just like in my hotel booking demand analysis, the Kaggle API was used to automatically download the dataset.