Smarter polling speed
bfirsh opened this issue · 0 comments
bfirsh commented
In wait()
and output_iterator()
we should be smarter about our polling speed. Start quick, to handle fast predictions, then slow down if prediction hasn't started, then speed up when prediction is processing, or something like that. Similar to the logic in the web client on Replicate.