Implement RMSprop in example/quadratic.f90
milancurcic opened this issue · 3 comments
milancurcic commented
Let's make the first implementation in the example program and then we'll have a better idea how we need to refactor the library to integrate it there.
Spnetic-5 commented
Hello @milancurcic, As you know RMSProp invloves retrieving the weights and gradients of the network's layers, in order to update the weights based on the gradients. I don't see implementation of these two in network code, so how are we planning the implemention exactly.
milancurcic commented
Yes, see #140 where I added the example program. In a nutshell, we need to iterate over each layer and use select type to access the internal data structure. There are a few places in the library where the same pattern is used.
milancurcic commented
Done by #144