onnx/onnx-tensorrt

how to use fp16 infer of onnx-tensorRT

lcaikk1314 opened this issue · 0 comments

lcaikk1314 commented

Hello, I would like to consult. Now I have tensorRT reasoning model of fp16, how to use fp16 infer of onnx-tensorRT