Adaptive damping
Opened this issue · 1 comments
phuvm72 commented
Describe the Request
Could you add adaptive damping features? Thanks
Sample Code
No response
gpauloski commented
Hi, @phuvm72! Unfortunately I do not have the time right now.
I encourage you to open a PR, and I'll be happy to review it. The KFACPreconditioner class already accepts a closure as the damping parameter so if you have a function which computes the adaptive damping at each step you can pass that function to the KFACPreconditioner.
I'll leave this issue open in the meantime in case you or someone else wants to work on it, but if it becomes stale I'll close it.