Add curriculum for Neural Mechanics paper
Closed this issue · 3 comments
ramasesh commented
I'd like to add a curriculum for the recent paper Neural mechanics: symmetry and broken conservation laws in deep learning dynamics. There is a lot of depth to this paper, and the payoff (being able to calculate exact training dynamics of certain parameter combinations) makes that worth studying. Like the Resurrecting the Sigmoid curriculum, I'd probably structure it to be mostly based around problem sets, except with more interactive (coding/jupyter notebook) problems. If this sounds good, I can get started.
cinjon commented
That sounds amazing. How can we help?
ramasesh commented
Sorry, I missed this. I'll submit a pull request with an outline soon, and any eyes on that would be very helpful!
cinjon commented
Sounds good!