theOGognf/finagg

Implement GPU-only Env

theOGognf opened this issue · 2 comments

theOGognf commented

Need to implement an Env protocol for the GPU-only algorithm implementation. It just needs the following:

  • num_envs, config, and device args and attributes
  • Observation and action specs
  • A step method
  • A reset method
  • A close method
theOGognf commented

Env interface is done, just needs testing and maybe some dummy envs for testing/debugging

theOGognf commented

This has been moved to the rlstack project