Contact
<surname>@fmph.uniba.sk
Grading
Three projects:
- Autograd - 20% - deadline 9th March
- Relativelly simple implementation of something exotic. Lottery tickets - 30% - deadline end of semester
- Final project aka Replication of recent paper results - 50%
- General deadline 25th June
- Deadline for 5th year students - around 27th May
Getting less than 50% from autograd project -> FX. Otherwise typical grading scheme (more than 90% - A, 89% - 80% - B, ..., 59 % - 50% - E, less than 50% - FX).
Useful links
Slides about reinforcement learning
Generative modelling
- summary blog post (also has links to previous methods)
Machine translation
CTC and transducers
Neural net behaviour
- Basic initialiation
- Double descent
- Flat minima are better
- Large minibatch might overfit
- Sharpness aware minimization, improved
- Shattered gradients
- ResNet are just ensembles
- Visualization of landscape