last observation
dtannebe opened this issue · 4 comments
dtannebe commented
it seems like there's no 'last observation', meaning there are equally many observations and actions.
but for a (s,a,s') like structure, there needs to be +1 state/observation, and generally, the last observation should be the state of the world AFTER an/the last action.
DavidRother commented
The store now holds one more observation that actions etc. fixing this issue.
dtannebe commented
after pulling the update, I still have the same problem.
dtannebe commented
is it related because I end the game with ESC when my demonstration is finished?
DavidRother commented
Yes that was exactly what happened and i fixed it now :)