guillec/ML-From-Scratch

Bare bones Python implementations of some of the fundamental Machine Learning models and algorithms.

Machine Learning From Scratch

###About Python implementations of some of the fundamental Machine Learning models and algorithms from scratch.

The purpose of this project is not to produce as optimized and computationally efficient algorithms as possible but rather to present the inner workings of them in a transparent way. The reason the project uses scikit-learn is to evaluate the implementations on sklearn.datasets.

Feel free to reach out if you can think of ways to expand this project.

Installation

pip install -r requirements.txt

Running Implementations

python supervised_learning/multilayer_perceptron.py

Figure: Classification of the digit dataset using MLP.

##Current Implementations ####Supervised Learning:

• Adaboost
• Decision Tree
• Gradient Boosting
• K Nearest Neighbors
• Linear Discriminant Analysis
• Linear Regression
• Logistic Regression
• Multi-class Linear Discriminant Analysis
• Multilayer Perceptron
• Naive Bayes
• Perceptron
• Random Forest
• Ridge Regression
• Support Vector Machine
• XGBoost

####Unsupervised Learning:

• Apriori
• DBSCAN
• FP-Growth
• Gaussian Mixture Model
• K-Means
• Partitioning Around Medoids
• Principal Component Analysis