on-device-ai
There are 86 repositories under on-device-ai topic.
NexaAI/nexa-sdk
On device AI inference in minutes—now for MLX & GGUF and Qualcomm NPU, with Android and iOS coming soon.
QiuYannnn/Local-File-Organizer
An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.
mit-han-lab/proxylessnas
[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
chongzhou96/EdgeSAM
Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"
mit-han-lab/TinyChatEngine
TinyChatEngine: On-Device LLM Inference Library
FaceAISDK/FaceAISDK_Android
离线版设备端人脸识别 动作活体、静默活体、近红外双目活体检测 以及1:N M:N 人脸搜索算法SDK 封装；全程可开飞行模式不用联网 🧒 on_device Face Recognition 、 Liveness detection and 1:N & M:N Face Search SDK
callstackincubator/ai
On-device LLM execution in React Native with Vercel AI SDK compatibility
NativeMindBrowser/NativeMindExtension
NativeMind: Your fully private, open-source, on-device AI assistant
facebookresearch/EdgeTAM
[CVPR 2025] Official PyTorch implementation of "EdgeTAM: On-Device Track Anything Model"
Samsung/ONE
On-device Neural Engine
woheller69/whisperIME
Android Input Method Editor (IME) based on Whisper
mit-han-lab/amc
[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices
gkonovalov/android-vad
Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.
Hugo-Dz/on-device-transcription
A ready-to-use, minimal app that converts any speech into text.
lookr-fyi/job-application-bot-by-ollama-ai
The world’s #1 end-to-end job agent: semantic filters, ATS-optimized resumes, referrals from hiring managers — 100% hands-free.
BrutalCoding/aub.ai
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
bd4sur/Nano
电子鹦鹉 / Toy Language Model
xliucs/MTTS-CAN
Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)
mit-han-lab/amc-models
[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices
sarim2000/pennywiseai-tracker
PennyWise automatically reads transaction SMS messages and transforms them into organized financial data with on-device AI assistance. No manual entry, no cloud processing, complete privacy.
hollance/coreml-training
Source code for my blog post series "On-device training with Core ML"
Picovoice/pico-cookbook
Recipes for on-device voice AI and local LLM
ubicomplab/rppg-web
This is a web demo for camera-based PPG sensing (rPPG).
neuralize-ai/edgerunner
Simplified AI runtime integration for mobile app development
mit-han-lab/bnn-icestick
Binary Neural Network on IceStick FPGA.
DaemonLoki/MyAppleIntelligence
Custom implementation of Apple Intelligence features
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
dineshsoudagar/local-llms-on-android
Run large language models like Qwen and LLaMA locally on Android for offline, private, real-time question answering and chat - powered by ONNX Runtime.
neuralize-ai/edgerunner-android
Kotlin bindings for Edgerunner
baochuquan/ios-vad
iOS Voice Activity Detection (VAD). Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.
cryptoboid/mytag
A Google Photos alternative, where your pictures never leave your phone! Classification happens on-device, leveraging pre-trained models. Available for Android and iOS.
roboflow/inference-server-old
Object detection inference with Roboflow Train models on NVIDIA Jetson devices.
zats/local-llm
Apple's FoundationModels for the web. Chrome and Safari, macOS and iOS
nicedreamzapp/nicedreamzapp
First iPhone app to run YOLOv8 with ALL 601 object classes — maxing out Neural Engine at 10 FPS + live OCR translation. 100% offline, 38.4 MB total. Research-grade AI on mobile.
cactus-compute/cactus-flutter
Cactus Flutter plugin: Run AI locally in your Flutter apps