Denys88/rl_games

SAC Integration

Closed this issue · 2 comments

cremebrule commented

Hi! Been using rl_games for a few months, awesome work guys :) Was wondering if the SAC integration will be ready anytime soon to try out?

Thanks!

Denys88 commented

Hi, it is almost done but SAC disappointed me. Hard to get highest score, requires more tuning than we expected.
We will make one more pass to test it and merge it :)

  • 👍1
Denys88 commented

Hi, @cremebrule I just pushed first version of the SAC. It works fine with brax.
It has a few limitations which I am going to fix soon:

  1. image inpit doesn't work. Only mlp
  2. asymmetric critic is not yet implemented
  3. nor rnn
    Feel free to run it like this:
    python runner.py --train --file rl_games/configs/brax/sac_humanoid.yaml