USCT-YQJ/custom_prpool_plugin

TensorRT custom plugin -> Prpool implement

TensorRT 8.5.3.1

TensorRT8.5.3.1 install and environment PATH settings refer to (https://zhuanlan.zhihu.com/p/682000051)

First use gcc make

Run make clean and make in the ./custom_prpool_plugin and generate .so file , just as follow:

Second use TensorRT python API generate .engine file

Run CUDA_VISIBLE_DEVICES=7 python src/python/unit_test_customPrpool.py, just as follow:

Finally use TensorRT python API run .engine file

Run CUDA_VISIBLE_DEVICES=7 python src/python/torch2onnx2trt_tgthead.py, just as follow:

Note:

this implement is checked to insure correct, as follow: