Denys88/rl_games

rl_device in Network

1tac11 opened this issue · 2 comments

1tac11 commented

Hi there, I am just wondering, in A2CBuilder in Network, which cuda device is actually used for the training and how would I hand down the sim_device respectively rl_device variables from env_creator: create_env_thunk in Isaacgmyenvs or alike into the Network class so I can put the tensors onto the right GPU for torchrun Multi-GPU training? Or is the right cuda-device set automatically?
Kind regards

1seck commented

guess its done in A2Cagent.init()

  • 🎉1