| Wed Sep 8 |
Motivation and Syllabus |
What is Machine Learning? Machine Learning
Rise of the Machines Talking Machine Episode 1 |
a1 posted |
| Fri Sep 10 |
Exploratory Data Analysis |
Gotta Catch'em all Why Not to Trust Statistics
Visualization Types Google Chart Gallery Other Tools |
|
| Mon Sep 13 |
Decision Trees |
A Visual Introduction to Machine Learning, Decision Trees Entropy
AI:AMA 18.2-3, ESL: 9.2, ML:APP 16.2 |
Big-O Notes, Week 1 Tutorials |
| Wed Sep 15 |
Fundamentals of Learning |
7 Steps of Machine Learning IID Cross-validation Bias-variance No Free Lunch
AI: AMA 18.4-5, ESL 7.1-7.4, 7.10, ML:APP 1.4, 6.5 |
Course Notation Guide
|
| Fri Sep 17 |
Probabilistic Classifiers |
Conditional probability (demo) Naive Bayes Probabilities and Battleship
ESL 4.3, ML: APP 2.2, 3.5, 4.1-4.2 |
Assignment 1 due
Probability Notes Probability Slides |
| Mon Sep 20 |
Non-Parametric Models |
K-nearest neighbours Decision Theory for Darts Norms
AI: AMA 18.8, ESL 13.3, ML:APP 1.4 |
|
| Wed Sep 22 |
Ensemble Methods |
Ensemble Methods Random Forests Empirical Study Kinect
AI: AMA 18.10, ESL: 7.11, 8.2, 15, 16.3, ML: APP 6.2.1, 16.2.5, 16.6 |
|
| Fri Sep 24 |
Clustering |
Clustering K-means clustering (demo) K-Means++ (demo)
IDM 8.1-8.2, ESL: 14.3 |
|
Mon Sep 27
|
More Clustering |
DBSCAN (video, demo) Hierarchical Clustering Phylogenetic Trees
IDM 8.4 |
|
Wed Sep 29
|
Outlier Detection |
Empirical Study
IDM 8.3, ESL 14.3.12, ML:APP 25.5 |
|
Fri Oct 1
|
Least Squares |
Linear Regression (demo, 2D data, 2D video) Least Squares Essence of Calculus Partial Derivative Gradient
ESL 3.1-2, ML:APP 7.1-3, AI:AMA 18.6
|
Assignment 2 due |
Mon Oct 4
|
Nonlinear Regression |
Why should one learn machine learning from scratch? Essence of Linear Algebra Matrix Differentiation Fluid Simulation (video)
ESL 5.1, 6.3 |
Linear Algebra Notes
Linear/Quadratic Gradients |
Wed Oct 6
|
Gradient Descent |
Gradient Descent Convex Functions |
|
Fri Oct 8
|
Finding Similar Items
(Bonus Lecture) |
MMD Chapter 3 |
|
| Mon Oct 11 |
|
THANKSGIVING - NO CLASS |
|
Wed Oct 13
|
Robust Regression |
ML:APP 7.4 |
|
Fri Oct 15
|
Feature Selection |
Genome-Wide Association Studies AIC, BIC
ESL 3.3 , 7.5-7 |
Assignment 3 due |
Mon Oct 18
|
Regularization |
ESL 3.4., ML:APP 7.5, AI:AMA 18.4 |
|
Wed Oct 20
|
More Regularization |
RBF video RBF and Regularization video
ESL 6.7, ML:APP 13.3-4 |
|
Thu Oct 21
|
|
MIDTERM (6:00-7:30pm) |
|
Fri Oct 22
|
Linear Classifiers |
Perceptron
ESL 4.5, ML:APP 8.5 |
|
Mon Oct 25
|
More Linear Classifiers |
Support Vector Machines
ESL 4.4, 12.1-2, ML:APP 8.1-3, 9.5 14.5, AI:AMA 18.9 |
|
Wed Oct 27
|
Feature Engineering |
Gmail Priority Inbox |
|
Fri Oct 29
|
Convolutions |
|
|
Mon Nov 1
|
Kernel Trick |
ESL 12.3, ML:APP 14.1-4 |
|
Wed Nov 3
|
Stochastic Gradient |
Stochastic Gradient
ML:APP 8.5 |
|
Fri Nov 5
|
Boosting |
AdaBoost (video) XGBoost (video)
ML:APP 16.4 |
Assignment 4 due
Max and Argmax Notes |
Mon Nov 8
|
MLE and MAP |
Maximum Likelihood Estimation
ML:APP 9.3-4 |
|
Wed Nov 10
|
Principal Component Analysis |
Principal Component Analysis
ESL 14.5, IDM B.1, ML:APP 12.2 |
|
| Fri Nov 12 |
|
MIDTERM BREAK - NO CLASS |
|
| Mon Nov 15 |
|
MIDTERM BREAK - NO CLASS |
|
Wed Nov 17
|
More PCA |
Making Sense of PCA SVD Eigenfaces |
|
Fri Nov 19
|
Sparse Matrix Factorization |
Non-Negative Matrix Factorization (original - access from UBC)
ESL 14.6, ML: APP 13.8 |
|
Mon Nov 22
|
Recommender Systems |
Recommender Systems Netflix Prize |
|
Wed Nov 24
|
Multi-Dimensional Scaling |
Nonlinear Dimensionality Reduction t-SNE demo
ESL 14.8-9, IDM B.2 |
Assignment 5 due |
Fri Nov 26
|
Deep Learning |
Google Video What is a Neural Network? Interactive Guide
ML:APP 16.5, ESL 11.1-4, AI: AMA 18.7 |
|
Mon Nov 29
|
More Deep Learning |
Fortune Article Deep Learning References Alchemy
ML:APP 28.3, ESL 11.5 |
|
Wed Dec 1
|
Convolutional Neural Networks |
Convolutional Neural Networks
ML:APP 28.4, ESL 11.7 |
|
Fri Dec 3
|
Bonus lecture |
Semi-Supervised Learning Label Propagation at Google
AlexNet |
|
Mon Dec 6
|
Bonus lecture |
PageRank Slides PageRank Math/Code, ESL 14.10, AI: AMA 22.3
Non-convex PL Inequality |
Assignment 6 due |