N-step ReplayBuffer's store use the wrong act?

Question

ty2000 opened this issue 5 years ago · 2 comments

In the N-step ReplayBuffer, the store() method stores act into the memory

self.acts_buf[self.ptr] = act

should't this be action instead? i.e.

self.acts_buf[self.ptr] = action

Answer 1 · 2019-07-12T05:05:26.000Z

Thanks for pointing it out. I will fix it asap.

Answer 2 · 2019-07-12T05:42:12.000Z

Fixed. Thanks for your opinion :)