andri27-ts/Reinforcement-Learning

Updating target network - Potential Bug

sai-prasanna opened this issue · 0 comments

sai-prasanna commented

Reinforcement-Learning/Week3/central_control.py

Line 55 in c57064f

self.target_nn = self.moving_nn

After loading the parameters of the moving network into the target network, why is the target network reference pointing to the moving network? Wouldn't this make the target network track the moving network in every update and make it ineffective?