How to measure the inference time?

Question

How to measure the inference time?

youngwanLEE opened this issue 7 years ago · 3 comments

youngwanLEE commented 7 years ago

Hi,

I want to know how to measure the inference time?

Did you use caffe time operator ? or Did you measure full time when VOC 4952 test images are tested ?

Thanks in advance :)

Answer 1 · 2017-08-31T17:28:04.000Z

Hi @youngwanLEE, We used a loop (more than 5000 times) and measured the mean time of the loop as the inference time of DSOD, we didn't use the caffe time operator.

Answer 2 · 2017-09-01T01:41:13.000Z

Hi, @szq0214 thanks for your reply.

I couldn't fully figure out your demonstration.

What kind of loop ? such as detection forward pass time?

SSD's original author commented he used total inference time when score_pascal.py program ended.

I want to measure the inference time by your same way.

Could you explain your concrete way?

Thanks :)

Answer 3 · 2017-09-04T03:20:14.000Z

Hi @youngwanLEE,
Our loop only measured the whole forward pass time without the data preprocessing (e.g., resize inputs). Inference time may be slightly off the SSD's value but not much.