dniku opened this issue 6 years ago · 1 comments
Currently code imports CnnPolicy from stable-baselines, but if we are to modify the architecture, it would be preferable to do that in our code instead of patching the library.
CnnPolicy
stable-baselines
Dupe of #3.