Question: is there any multi-threading inference example?

Hi
I have gone through the test examples but didn't find any multi-threading inference example. Maybe I missed it. Could you point such examples to me?

Or, is the experiment code for Fig.5 in this paper shared anywhere? If so could you point it to me too?

Thanks

Sorry for the late reply.

We have two examples of multithreading. The first is in our test case

multipy/multipy/runtime/test_deploy.cpp

Line 163 in 19617b9

TEST(TorchpyTest, ThreadedSimpleModel) {

The second is our benchmarking (though its a bit changed from whats used in the paper) https://github.com/pytorch/multipy/blob/main/multipy/runtime/example/benchmark.cpp