Anjum48/rl-examples

Experimental details on CarRacing

Closed this issue · 2 comments

kimhc6028 commented

Hi, thank you for your great works. This is the best repo that beats CarRacing.
I thought CarRacing results best performance with ppo_lstm_joined.py, but how long did it take to train? Is number of episode of 10000 enough? I just want to make sure before training it myself....

Anjum48 commented

Hi, thank you very much! I usually trained to about 4000 episodes, but I found that performance would ramp up to about 500 episodes before becoming unstable (you might get a handful of episodes > 900). I'm not entirely sure why (maybe due to #3) but if you have any ideas, let me know and I'll test/update

screenshot from 2018-09-27 16-34-29

kimhc6028 commented

Thank you!! If I can find any improvements luckily, I will report it!