TRTForYolov3-tiny
Desc
tensorRT for Yolov3-tiny (onnx to tensorrt)
Test Enviroments
Ubuntu 18.04/ win10
TensorRT 5.1.5.0/5.1.2.2/5.0.4.3
CUDA 10.0/9.0
Models
Convert your model to onnx model, if your model is trained by DarkNet, check my repo https://github.com/faedtodd/Tensorrt-Yolov3-tiny
Run Sample
#build source code
git submodule update --init --recursive
mkdir build
cd build && cmake .. && make && make install
cd ..
#for fp16
#for yolov3-tiny-608
./install/runYolov3 --onnxmodel=./ped.onnx --enginefile=./ped.trt --input=./test.jpg
Performance
| Model |
GPU |
Mode |
Inference Time |
| Yolov3-tiny-608 |
GTX 1060 |
fp16 |
6.9335ms |
| Yolov3-tiny-608 |
Tx2 |
fp16 |
20.3274ms |
| Yolov3-416 |
GTX 1060 |
fp16 |
26.817ms |
| Yolov3-416 |
Tx2 |
fp16 |
74.1937ms |