Switch to new OpenAI Gym step API

Question

Switch to new OpenAI Gym step API

xiaomengy opened this issue 2 years ago · 2 comments

The new version of OpenAI Gym uses a new step API which returns (observations, reward, termination, truncation, info) instead of (observations, reward, done, info). We have to make the wrappers to support this.

Track this progress in this issue.

Answer 1 · 2022-10-05T13:40:48.000Z

Would this wrapper help? https://github.com/openai/gym/blob/master/gym/wrappers/step_api_compatibility.py

Answer 2 · 2022-10-05T15:43:54.000Z

Thanks for the advice. Yes, that's one way to do this. Our plan is to use this for short term but will investigate more ways to see if we can do it better.