quantumiracle/Popular-RL-Algorithms

please evaluate the performance over multiple seeds

Closed this issue · 1 comments

In the README down below, the performance evaluations are done only on a single seed.
Please evaluate over multiple seeds because as of now the results can be random and are thus not comparable.

I appreciate your suggestion. However, as this is not an officially released repo (I didn't spend much time on maintaining this), I will not provide thorough evaluation of algorithms. Please feel free to do this by yourself (it should be quite straightforward with a bash script passing random seeds into some arguments for running, since each algorithm script is independent), and I welcome such contribution in this repo if you have done that! Thanks.