does this work with mountaincar and other gym environments

[simin75simin]

if i just chagne cartpole to mountaincar in chapter 8, it pretty much does not work. is there a way to make it work though? do you consider making it like stable baselines, running on all sorts of environments?

thanks.

[Curt-Park]

1. You should set the parameters so that it aligns well with another environment, especially in terms of C51.
2. Most of implementations here are originated from RL Algorithm Repo, which is designed as a general RL framework.

[simin75simin]

thanks