vwxyzjn/cleanrl

Is SAC exploration-noise used?

StoneT2000 opened this issue · 1 comments

StoneT2000 commented

Was looking at the SAC continuous action implementation and I noticed theres an used exploration-noise parameter. Is this used anywhere (or by any other libs?)

https://github.com/vwxyzjn/cleanrl/blob/master/cleanrl/sac_continuous_action.py#L52

Currently trying to compare my own code with OpenRL Benchmark results so was trying to align the hyperparameters.

vwxyzjn commented

Ah this is probably just copied and pasted from the ddpg base implementation. Let me make a PR to remove it.

  • 👍1