onnx-runtime
There are 69 repositories under onnx-runtime topic.
snakers4/silero-vad
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
royshil/obs-backgroundremoval
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
StarlightSearch/EmbedAnything
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
NickSwardh/YoloDotNet
YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and live video streams.
dme-compunet/YoloSharp
🚀 A high performance real-time object detection solution using YOLO11 ⚡️ powered by ONNX-Runtime
jobergum/browser-ml-inference
Edge Inference in Browser with Transformer NLP model
nbigaouette/onnxruntime-rs
Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
FaceONNX/FaceONNX
Face recognition and analytics library based on deep neural networks and ONNX runtime
triton-inference-server/onnxruntime_backend
The Triton backend for the ONNX Runtime.
Shannon-Data/ShannonBase
The Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.
Yulv-git/Model-Inference-Deployment
A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
emptysoal/tensorrt-experiment
Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.
COO1M/SRMaster
基于Real-ESRGAN的图片AI超分辨率安卓APP
ms-iot/ros_msft_onnx
ONNX Runtime for the Robot Operating System (ROS), works on ROS1 and ROS2
zz990099/EasyDeploy
C++ implementations of YOLOv8, RT-DETR-V2(RTDETR), MobileSAM, and NanoSAM on TensorRT, ONNX Runtime, and RKNN.
josephrocca/super-resolution-js
SOTA image super-resolution in JavaScript/Wasm using an ONNX-ported SwinIR model
PT-Perkasa-Pilar-Utama/ppu-yolo-onnx-inference
Easily run YOLOv11 object detection models in a TypeScript Bun environment. No Python, PyTorch, or heavy dependencies needed.
itlab-vision/dl-benchmark
Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apache TVM, ncnn, PaddlePaddle, etc.
chinoll/deepdanbooru_onnx
Easy-to-use danbooru anime image classification model
renesas-rz/meta-renesas-ai
Renesas RZ/G AI BSP
dineshsoudagar/local-llms-on-android
Run large language models like Qwen and LLaMA locally on Android for offline, private, real-time question answering and chat - powered by ONNX Runtime.
LIU42/FlowerClassify
基于 ResNet 的花卉分类识别系统。
Mobile-Artificial-Intelligence/babylon.cpp
Babylon.cpp is a C and C++ library for grapheme to phoneme conversion and text to speech synthesis. For phonemization a ONNX runtime port of the DeepPhonemizer model is used. For speech synthesis VITS models are used. Piper models are compatible after a conversion script is run.
mtszkw/fast-torch
Comparing PyTorch, JIT and ONNX for inference with Transformers
instant-high/deoldify-onnx
Easy to install image and video colorization using onnx converted deoldify model
jonathanpeppers/inclusive-code-reviews-ml
Machine learning for code reviews!
Ave-Sergeev/Dictator
Offline STT & VAD Service (Rust, Tonic) (Q1:2025)
kaiidams/Voice100AndroidApp
Voice100 Android App is a TTS/ASR sample app that uses ONNX Runtime and Voice100 neural TTS/ASR models on Xamarin. Inference of Voice100 is low cost as its models are tiny and only depend on CNN without recursion.
HighPoint/aws-lambda-onnx-model
Run ONNX machine learning models on AWS Lambda
ashrafgt/onnx-keras-example
Keras/Tensorflow Neural Network Conversion to ONNX and Inference with ONNX Runtime
domenicostefani/deep-classf-runtime-wrappers
Classification wrappers for 4 Deep Learning Embedded Runtimes for Music Information Retrieval, plus utilities to convert a TensorFlow Model
HoangHPham/Table-Detection-From-YOLOv7-to-Flask
A Flask app that detects table using ONNX model exported from YOLOv7
CartesianXR7/scout-vision
Real-time computer vision for embedded Rust with OpenCV and YOLOv8 built with resource-constrained devices such as the Raspberry Pi Zero 2W in mind.
ZygoteCode/VadSharp
Enterprise VAD (Voice Activity Detection) in C#.NET (.NET 6.0+) with Microsoft.ML.Net, ONNXRuntime and DirectML. The easiest, efficient, and performant Silero VAD implementation! Always open for PRs.