batra-mlp-lab/visdial-rl

How to run evaluate.py

okisy opened this issue · 1 comments

okisy commented

Hello.
Thank you for sharing your great work!

After running
python evaluate.py -useGPU \ -startFrom checkpoints/abot_sl_ep60.vd \ -qstartFrom checkpoints/qbot_sl_ep60.vd \ -evalMode ABotRank QBotRank>
, I had lots of the following error

[Errno110] Connection timed out

I guess before running
python evaluate.py -useGPU \ -startFrom checkpoints/abot_sl_ep60.vd \ -qstartFrom checkpoints/qbot_sl_ep60.vd \ -evalMode ABotRank QBotRank
, I should run
python -m visdom.server -p <port>
in order to visualize the evaluation result.
Is it correct?

If not, how should I deal with this code?

nirbhayjm commented

Thanks for pointing this out - currently all evaluations need a visdom server for plotting and displaying results. I have updated the evaluation commands in the README to reflect this in 0772561.