Target network updates / Double-Dueling-DQN.ipynb
sanderfeliz opened this issue · 1 comments
sanderfeliz commented
From my understanding the target network updates are implemented wrong in the notebook Double-Dueling-DQN.ipynb.
As it updates the same step as the main network (every 4th). In this simple environment no difference will be observed but I believe for the purpose of better understanding the concept it would be nice to fix that!
Michaeljurado42 commented
omg i thought the same thing