What is the default value of timeout of the post request in predict_server?

Question

LegendaryDan opened this issue 5 years ago · 2 comments

Is there any default value of timeout of the post request in predict_server.py?

Thanks.

Answer 1 · 2019-07-17T05:13:02.000Z

Hi,

There is no explicit timeout value. We ask that your model averages < 1 second per question across the out-of-domain examples (9633 total).

Answer 2 · 2019-07-17T05:14:09.000Z

Sorry, forgot to mention this is on our evaluation server, which will have one Titan Xp GPU.