Cannot reproduce the results of IQL on antmaze
Opened this issue · 1 comments
Shenzhi-Wang commented
I've run examples/iql/antmaze_finetune.py, but the results are so bad, oscillating between 0 and 1 (as shown in the figure below), which are totally different from the result figures in examples/iql/README.md.
anair13 commented
I think you just need to smooth (each epoch contains 1 rollout which either succeeds or fails), can you average the returns over a moving window and plot it again? Our results were plotted with https://github.com/rail-berkeley/rlkit/blob/master/rlkit/visualization/plot_util.py