onnxruntime
There are 717 repositories under onnxruntime topic.
niedev/RTranslator
Open source real-time translation app for Android that runs locally
snakers4/silero-vad
Silero VAD: pre-trained enterprise-grade Voice Activity Detector
RapidAI/RapidOCR
📄 Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.
deepjavalibrary/djl
An Engine-Agnostic Deep Learning Framework in Java
xlite-dev/lite.ai.toolkit
🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉
royshil/obs-backgroundremoval
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
remsky/Kokoro-FastAPI
Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching
huggingface/optimum
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
open-mmlab/mmdeploy
OpenMMLab Model Deployment Framework
menloresearch/cortex.cpp
Local AI API Platform
Djdefrag/QualityScaler
QualityScaler - image/video AI upscaler app
ppogg/YOLOv5-Lite
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
thewh1teagle/kokoro-onnx
TTS with kokoro and onnx runtime
notAI-tech/NudeNet
Lightweight nudity detection
emilianavt/OpenSeeFace
Robust realtime face and facial landmark tracking on CPU with Unity integration
ricky0123/vad
Voice activity detector (VAD) for the browser with a simple API
pykeio/ort
Fast ML inference & training for ONNX models in Rust
yinguobing/head-pose-estimation
Realtime human head pose estimation with ONNXRuntime and OpenCV.
lemonade-sdk/lemonade
Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
microsoft/ai-dev-gallery
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
pur1fying/blue_archive_auto_script
支持按轴凹总力战, 无缝制造三解, 用于实现蔚蓝档案自动化的程序( Steam已适配 )
PriesiaMioShirakana/DragonianVoice
多个SVC/TTS的C++推理库
PaddlePaddle/Paddle2ONNX
ONNX Model Exporter for PaddlePaddle
RedisAI/redis-inference-optimization
A Redis module for serving tensors and executing deep learning graphs
rnchg/APT
AI Productivity Tool - Free and open source, improve user productivity, and protect privacy and data security. Including but not limited to: built-in local exclusive ChatGPT, DeepSeek, Phi, Qwen and other models, one-click batch intelligent processing of pictures, videos, audio, etc.
zhiqwang/yolort
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
StarlightSearch/EmbedAnything
Highly Performant, Modular and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
Ki6an/fastT5
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
xaviviro/refacer
Refacer: One-Click Deepfake Multi-Face Swap Tool
stochasticai/x-stable-diffusion
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
Kazuhito00/Image-Processing-Node-Editor
処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)
fabio-sim/LightGlue-ONNX
ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO
ibaiGorordo/ONNX-YOLOv8-Object-Detection
Python scripts performing object detection using the YOLOv8 model in ONNX.
yalue/onnxruntime_go
A Go (golang) library wrapping microsoft/onnxruntime.
fabio-sim/Depth-Anything-ONNX
ONNX-compatible Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data
xmba15/onnx_runtime_cpp
small c++ library to quickly deploy models using onnxruntime