Continuous Butterfly Presets
cpnota opened this issue · 3 comments
cpnota commented
Add multiagent presets for the Butterfly continuous environments.
benblack769 commented
One thing blocking this is that several internal features, including the generalized advantage buffer used by PPO, only work for parallel agents. And there is no parallel multiagent experiment.
cpnota commented
Good to know. Will probably have to do some additional changes. Have you tried SAC/DDPG?