- Following Andrej's video step-by-step, learning NN ——JackWang
Lecture 1: The spelled-out intro to neural networks and backpropagation: building micrograd
Done 1st notebook run through in 2024.2.29-3.3
Lecture 2: The spelled-out intro to language modeling: building makemore
Done 1st notebook run through in 2023.11.20-11.25
Lecture 3: Building makemore Part 2: MLP
Done 1st notebook run through in 2023.11.20-11.25
Lecture 4: Building makemore Part 3: Activations & Gradients, BatchNorm
Going through right now.
Lecture 5: Building makemore Part 4: Becoming a Backprop Ninja
Not started yet.
Lecture 6: Building makemore Part 5: Building WaveNet
Not started yet.
Lecture 7: Let's build GPT: from scratch, in code, spelled out.
Not done, currently at 1:19:11 in the youtube video. 2023.11.28 p.m. Done 1st notebook run through and the youtube video. 2023.11.30 a.m.