Question: Does libonnx support dynamic shape/CUDA ?
delldu opened this issue · 4 comments
delldu commented
Dear friends,
Thanks for good job.
We have two question: 1) Does libonnx support dynamic shape input ? If not, how to implement it ? (Just some hints.);
2) How to support CUDA inference on libonnx ?
jianjunjiang commented
see struct onnx_tensor_t, this can expressd for any data type, CUDA inference, you must write a struct onnx_resolver_t, this is a iterface for some hardware acceleration
delldu commented
@jianjunjiang ,Thank you. We also wonder how support dynamic input shape with libonnx ? Would you please give us some advance ?
jianjunjiang commented
using onnx_tensor_apply function to modify input tensor
delldu commented
Many thanks.