Question: is there any multi-threading inference example?
KexinFeng opened this issue · 1 comments
KexinFeng commented
Hi
I have gone through the test examples but didn't find any multi-threading inference example. Maybe I missed it. Could you point such examples to me?
Or, is the experiment code for Fig.5 in this paper shared anywhere? If so could you point it to me too?
Thanks
PaliC commented
Sorry for the late reply.
We have two examples of multithreading. The first is in our test case
multipy/multipy/runtime/test_deploy.cpp
Line 163 in 19617b9
The second is our benchmarking (though its a bit changed from whats used in the paper) https://github.com/pytorch/multipy/blob/main/multipy/runtime/example/benchmark.cpp