[Question] Matching between terminals, timeouts, truncated, terminated, done
qgallouedec opened this issue · 0 comments
qgallouedec commented
Question
Currently, D4RL requires gym<0.25, i.e. versions for which there is no distinction between done due to a truncation condition and done due to a terminal state.
However, when you load D4RL, you have timeouts
and terminal
. I feel that there are premises of this distinction in D4RL but the semantics question me:
Is timeouts
equivalent to truncated
(gym>=0.25)?
Is terminals
equivalent to done
(gym<0.25)? or to terminated
(gym>=0.25)?