rdasxy/ML-From-Scratch

Bare bones Python implementations of some of the fundamental Machine Learning models and algorithms.

Machine Learning From Scratch

###About Python implementations of some of the fundamental Machine Learning models and algorithms from scratch.

While some of the matrix operations that are implemented by hand (such as calculation of covariance matrix) are available in numpy I have decided to add these as well to make sure that I understand how the linear algebra is applied. The reason the project uses scikit-learn is to evaluate the implementations on sklearn.datasets.

The purpose of this project is purely self-educational.

Feel free to reach out if you can think of ways to expand this project.

Installation

pip install -r requirements.txt

Running Implementations

python demo.py
python supervised_learning/multilayer_perceptron.py

##Current Implementations ####Supervised Learning:

• Adaboost
• Decision Tree (regression and classification)
• Gradient Boosting (regression and classification)
• K Nearest Neighbors
• Linear Discriminant Analysis
• Linear Regression
• Logistic Regression
• Multi-class Linear Discriminant Analysis
• Multilayer Perceptron
• Naive Bayes
• Perceptron
• Random Forest
• Ridge Regression
• Support Vector Machine

####Unsupervised Learning:

• Apriori
• DBSCAN
• FP-Growth
• Gaussian Mixture Model
• K-Means
• Partitioning Around Medoids
• Principal Component Analysis