denisyarats/pytorch_sac

Help to speed up the code

shreyask3107 opened this issue · 5 comments

shreyask3107 commented

Hi, the code currently takes around 15hours for a million epochs, could you guide me into increasing this speed and not deteriorating the performance. As the compute required for the code is pretty less, i would like to utilize them to speed up. Thanks!

denisyarats commented

Hi, I'm currently working on speeding this code up. If you look at the ddpg branch, there is experimental implementations of SAC / DDPG what work much faster, but I haven't fully tested them yet.

shreyask3107 commented

Thank You for the update, that would help me a lot.

shreyask3107 commented

Could you give me an idea of how much faster this is expected to be from the earlier code?

denisyarats commented

Hi, it should be way faster, on my machine 1M of environment steps takes less than 2 hours on a single GPU. So most of the tasks from DM control should be solved in 2 hours or so.

shreyask3107 commented

Wow, Thanks!