emasquil/ppo

Clip value loss

Closed this issue · 1 comments

theovincent commented
Clip value loss
emasquil commented

We didn't have time to do this although the issue of huge value loss was partially solved by normalizing the rewards