support for one hot plugin with dynamic axis other than batch_size dim

Question

support for one hot plugin with dynamic axis other than batch_size dim

frankxyy opened this issue 2 years ago · 4 comments

I read the code of one hot plugin generation. It seems that it only support dynamic axis of batch size dimension. Can tpat support one hot plugin generation with dynamic axises other than batch_size dimension?

Answer 1 · 2023-03-20T12:19:35.000Z

@frankxyy Currently we don't support dynamic batch_size on other dimensions. You may try to add Transpose before and after one_hot node in ONNX graph.

Answer 2 · 2023-03-21T15:30:56.000Z

@wenqf11 Hi, why adding Transpose before and after one_hot node can avoid issues of dynamic dims? I suppose the transpose node cannot infer the exact tensort shape at runtime.

Answer 3 · 2023-03-23T03:26:24.000Z

@frankxyy If your ONNX model has more than one dynamic dimensions, we cannot support currently. Otherwise, only one dynamic diemnsion, you can Transpose it to the first dimension. It may cost more time to run it with Transpose.

Answer 4 · 2023-03-24T08:15:08.000Z

@wenqf11 Thank you. Got it.