/Machine-Learning-Implementations

Contains scratch implementations of some popular Machine Learning & Deep Learning algorithms in Python

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

Machine-Learning

Contains scratch implementations of some popular Machine Learning and Deep Learning algorithms in Python

Algorithms included

  1. Gaussian Naive Bayes
  2. Bootstrap Aggregation (Bagging)
  3. KMeans Clustering
  4. Principal Component Analysis (PCA)
  5. Linear Discriminant Analysis (LDA)
  6. Bidirectional Feature Selection
  7. Multilayer Perceptron (MLP) - Forward propagation, Backward propagation
  8. Logistic Regression
  9. Multivariate SGD Regression

Error Functions

  1. Mean squared error
  2. Mean absolute error

Utilities

  1. Gradient Descent
  2. Plot decision boundary
  3. Gini Index
  4. Continuous to Categorical (cont_to_cat)
  5. Covariance
  6. Mahalanobis distance

LDA utitilies -

  1. split_class_wise
  2. within_class_means
  3. overall_mean
  4. within_class_scatter_matrix
  5. between_class_scatter_matrix