Small bug in ppo.py, in _get_batches_starting_indexes function
mansur007 opened this issue · 0 comments
mansur007 commented
Hi,
when self.recurrence is 1,
indexes = indexes[(indexes + self.recurrence) % self.num_frames_per_proc != 0]
removes the self.num_frames_per_proc-1 from indexes.
I think it is a bug. Can you check?
Thank you