/Statistical-Machine-Learning-and-Data-Mining

Algorithms in Statistical Machine Learning and Data Mining

Primary LanguageJupyter Notebook

Statistical-Machine-Learning-and-Data-Mining

Support Vector Machine

  • Files
    • Support Vector Machines.ipynb
  • Implement the SVM using scikit-learn
  • Implement the SVM using the Sequential Minimal Optimisation (SMO) Algorithm from scratch

Discriminant Linear Classifiers

  • Files
    • Discriminant Linear Classifiers.ipynb
  • Least-Square Linear Classifier
  • Fisher's Linear Discriminate
  • Perceptron Algorithm

K-Means

  • Files
    • K-Means.ipynb
    • Alternative K-Means.ipynb
  • Implement K-Means from scratch
  • Implement an alternative to k-means from scratch

K-NN

  • Files
    • k-Nearest Neighbor Classifier.ipynb
    • kNN from scratch.ipynb
  • Implement the k-NN using scikit-learn
  • Compared 1-NN to Voronoi cells
  • Implement the k-NN from scratch

Gaussian Mixtures

  • Files
    • EM Algorithm for Gaussian Mixtures.ipynb
  • Implement the EM Algorithm for Gaussian Mixtures