Sea-Snell/Implicit-Language-Q-Learning

Question about the max steps

maxiao94 opened this issue · 1 comments

Hi,
Thanks for your good job. However, when I try to reproduce the results in the paper, I am confused about how to set the max steps (Null in config.yaml).
I appreciate any suggestions.

Thanks for the question! Usually, you will set a number of epochs and leave max_steps=null, but for iterable datasets, you may want to set epochs=1 and instead specify a max_steps. If you set both it will just stop whenever the first one is reached. If you just want to set epochs, max_steps can be null. I hope this answers your question, let me know if not.