151ali/triton-inference-server-examples

Use triton inferance server

cd docker
docker-compose up

Resources

• https://cloudgurupayments.medium.com/deploying-an-object-detection-model-with-nvidia-triton-inference-server-38174796ba6c
• https://developer.nvidia.com/blog/deploying-models-from-tensorflow-model-zoo-using-deepstream-and-triton-inference-server/
• https://github.com/penolove/yolov4_triton_client/blob/master/simple_grpc_infer_client.py

Pre-trained model

• SSD
• ssd2
• Yolo v4
• yolov4 lite ok
• openPose

TRITON manipulation

• Python backend