This is probably possible but just hasn't been thought through with the recent switch to OpenVINO's "API 2.0" interface. It may relate a bit to your other question, #133, in that we need to ensure that Tensor can indeed be safely passed around between threads.