inarikami/keras-rl2

Reference to model is changed when training starts

Icemole opened this issue · 0 comments

Hello. First of all, I am using version 1.0.3 but the issue holds for the latest (1.0.4) version. My problem is that the reference to my model is being messed up with. I need to use the reference to my created model throughout the training, but as soon as the training starts, it suddenly becomes a reference to an Agent, in my case a DQNAgent.

It would be great not to have any side effects when starting the training, since the model variable could still be used after having started the training, as was my case. I have been searching for solutions and I found out that I was not the only one having problems with this: there are some issues on the original repository which indirectly address this as well. As a result, this library (as well as its predecessor) ends up not being fully compatible with some of the original Keras stuff, such as the TensorBoard callback: see keras-rl/keras-rl#255.