emasquil/ppo

remove observation_tp1

Closed this issue · 0 comments

theovincent commented

change replace in policy update: not making it inplace