Machine Learning Foundations & Techniques

Machine learning is the study that allows computers to adaptively improve their performance with experience accumulated from the data observed. Our two sister courses teach the most fundamental algorithmic, theoretical and practical tools that any user of machine learning needs to know.

Certification :

Machine learning foundations

Machine learning is the study that allows computers to adaptively improve their performance with experience accumulated from the data observed. Our two sister courses teach the most fundamental algorithmic, theoretical and practical tools that any user of machine learning needs to know.

The first course of the two would focus more on mathematical tools.
The second course of the two would focus more on algorithmic tools.

Week 1 ~ Week 4

  • week 1 : The Learning Problem
  • week 2 : Learning to Answer Yes/No
  • week 3 : Types of Learning
  • week 4 : Feasibility of Learning
  • Programming assignment-1 : PLA & Pocket Algorithm

Week 5 ~ week 8

  • week 5 : Training versus Testing
  • week 6 : Theory of Generalization
  • week 7 : The VC Dimension
  • week 8 : Noise and Error
  • Programming assignment-2 : Decision Stump

Week 9 ~ week 12

Week 13 ~ week 16

Machine learning techniques

The course extends the fundamental tools in "Machine Learning Foundations" to powerful and practical models by three directions, which includes embedding numerous features, combining predictive features, and distilling hidden features.

Week 1 ~ Week 4

  • week 1 : Linear Support Vector Machine
  • week 2 : Dual Support Vector Machine
  • week 3 : Kernel Support Vector Machine
  • week 4 : Soft-Margin Support Vector Machine
  • Programming assignment-5 : Support Vector Machine

Week 5 ~ week 8

  • week 5 : Kernel Logistic Regression
  • week 6 : Support Vector Regression
  • week 7 : Blending and Bagging
  • week 8 : Adaptive Boosting
  • Programming assignment-6 : AdaBoost Stump & Least Square SVM

Week 9 ~ week 12

  • week 9 : Decision Tree
  • week 10 : Random Forest
  • week 11 : Gradient Boosted Decision Tree
  • week 12 : Neural Network
  • Programming assignment-7 : Decision Tree & Random Forest

Week 13 ~ week 16

Course Links and Reference:

  1. Machine learning foundations part I
  2. Machine learning foundations part II
  3. Machine learning Techniques