NUM_STEPS or NUM_EPISODES?
Closed this issue · 1 comments
chao1224 commented
Just want to confirm one thing.
So in this line, should this self.NUM_STEPS be the number of episodes in the context of RL?
Appreciate any help.
MarcusOlivecrona commented
Hi,
In every training step, batch_size episodes are sampled as a batch. Therefor, the total number of episodes sampled would be batch_size * num_steps.
Marcus