Can we exclude the accuracy computation from the inference time and preload the dataset into memory?

Question

Can we exclude the accuracy computation from the inference time and preload the dataset into memory?

jgong5 opened this issue 7 years ago · 4 comments

Answer 1 · 2018-04-21T01:32:49.000Z

For inference time and cost submissions, yes, you can exclude the accuracy computation and preload the dataset into memory.

Answer 2 · 2018-04-21T02:36:28.000Z

Thanks. Our previous submission included both dataset loading and accuracy computation. Can we amend the result after the submission deadline?

Answer 3 · 2018-04-21T04:47:12.000Z

Changes after the deadline will be handled on a case by case basis given the circumstances and magnitude of the situation. I can't guarantee that it will be allowed. For reference, what submission are you referring to?

Answer 4 · 2018-04-23T04:24:32.000Z

@codyaustun Thanks. I was referring to all the ImageNet inference related submissions from Intel.