MorvanZhou/pytorch-A3C

Shared local and global parameters

mfl22 opened this issue · 0 comments

mfl22 commented

Shouldn't parameters of local and global networks be synchronized:

pytorch-A3C/discrete_A3C.py

Line 73 in 5ab27ab

self.lnet = Net(N_S, N_A) # local network

lnet and gnet are not initialized with the same parameters here ? Probably lnet.load_state_dict(gnet.state_dict()) is missing.

For example, see implementation in https://github.com/ikostrikov/pytorch-a3c/blob/48d95844755e2c3e2c7e48bbd1a7141f7212b63f/train.py#L37.