tensorrt-inference
There are 49 repositories under tensorrt-inference topic.
jolibrain/deepdetect
Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
ltkong218/FastFlowNet
FastFlowNet: A Lightweight Network for Fast Optical Flow Estimation (ICRA 2021)
LCH1238/bevdet-tensorrt-cpp
BEVDet implemented by TensorRT, C++； Achieving real-time performance on Orin
kamalkraj/stable-diffusion-tritonserver
Deploy stable diffusion model with onnx/tenorrt + tritonserver
NVIDIA-ISAAC-ROS/isaac_ros_dnn_inference
NVIDIA-accelerated DNN model inference ROS 2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU
BlueMirrors/Yolov5-TensorRT
Yolov5 TensorRT Implementations
yuvraj108c/ComfyUI-Depth-Anything-Tensorrt
ComfyUI Depth Anything Tensorrt Custom Node (up to 5x faster), licensed under CC BY-NC-SA 4.0
col-in-coding/Tensorrt-CV
Using TensorRT for Inference Model Deployment.
zonghaofan/dbnet_torch
you can use dbnet to detect word or bar code,Knowledge Distillation is provided,also python tensorrt inference is provided.
YuzhouPeng/unet-tensorrt
this is a tensorrt version unet, inspired by tensorrtx
teamunitlab/yolo8-segmentation-deploy
Production-ready YOLO8 Segmentation deployment with TensorRT and ONNX support for CPU/GPU, including AI model integration guidance for Unitlab Annotate.
storrrrrrrrm/tensorrt_smoke
3d object detection model smoke c++ inference code
gpastal24/ViTPose-Pytorch
VitPose without MMCV dependencies
spacewalk01/nanosam-cpp
C++ TensorRT Implementation of NanoSAM
leandro-svg/SparseInst_TensorRT
The real-time Instance Segmentation Algorithm SparseInst running on TensoRT and ONNX
emptysoal/tensorrt-experiment
Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.
thaitc-hust/Yolo-TensorRT
Convert yolo models to ONNX, TensorRT add NMSBatched.
jagennath-hari/DepthStream-Accelerator-ROS2-Integrated-Monocular-Depth-Inference
DepthStream Accelerator: A TensorRT-optimized monocular depth estimation tool with ROS2 integration for C++. It offers high-speed, accurate depth perception, perfect for real-time applications in robotics, autonomous vehicles, and interactive 3D environments.
gitctrlx/NarrativeCanvas
"Narrative Canvas" project is an edge computing project based on Nvidia Jetson. It can transform uploaded images into captivating stories and artworks.
k9ele7en/ONNX-TensorRT-Inference-CRAFT-pytorch
Advance inference performance using TensorRT for CRAFT Text detection. Implemented modules to convert Pytorch -> ONNX -> TensorRT, with dynamic shapes (multi-size input) inference.
lzh420202/TensorRT_Inference
An oriented object detection framework based on TensorRT
emptysoal/Deepsort-YOLOv5-TensorRT
An object tracking project with YOLOv5-v5.0 and Deepsort, speed up by C++ and TensorRT.
emptysoal/YOLOv5-TensorRT-lib-Python
The code of YOLOv5 inferencing with TensorRT C++ api is packaged into a dynamic link library , then called through Python.
emptysoal/TensorRT-v8-YOLOv5-v5.0
Based on TensorRT v8.2, build network for YOLOv5-v5.0 by myself, speed up YOLOv5-v5.0 inferencing
surajiitd/NVIDIA_Jetson_Inference
This repo contains model compression(using TensorRT) and documentation of running various deep learning models on NVIDIA Jetson Orin, Nano (aarch64 architectures)
CuteBoiz/TensorRT_Parser_Cpp
Export (from Onnx) and Inference TensorRT engine with C++.
CuteBoiz/TensorRT_Parser_Python
Export (from Onnx) and Inference TensorRT engine with Python
CactusQ/TensorRT-LLM-Tutorial
Getting started with TensorRT-LLM using BLOOM as a case study
Jayveersinh-Raj/Cross_lingual_abuse_detection
In this work we applied multilingual zero-shot transfer concept for the task of toxic comments detection. This concept allows a model trained only on a single-language dataset to work in arbitrary language, even low-resource.
MaximeDebarbat/Dolphin
Dolphin is a python toolkit meant to speed up inference of TensorRT by providing CUDA-Accelerated processing.
yester31/TensorRT_ONNX
Generating tensorrt model using onnx
gitctrlx/xtrt
A lightweight, high-performance deep learning inference tool.
ycchen218/Pytorch-to-TensorRT-example
This is an mnist example of how to transfer a .pt file to .onnx, then transfer .onnx file to .trt file.
emptysoal/TensorRT-YOLOv8
Based on tensorrt v8.0+, deploy detect, pose, segment of YOLOv8 with C++ and python api.