on-device-ai

There are 39 repositories under on-device-ai topic.

  • NexaAI/nexa-sdk

    Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

    Language:Python5.6k59471810

  • QiuYannnn/Local-File-Organizer

    An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

    Language:Python1.9k2230143

  • mit-han-lab/proxylessnas

    [ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

    Language:C++1.4k700286

  • chongzhou96/EdgeSAM

    Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"

    Language:Jupyter Notebook959183842

  • mit-han-lab/TinyChatEngine

    TinyChatEngine: On-Device LLM Inference Library

    Language:C++790164376

  • AnyLifeZLB/FaceVerificationSDK

    Android On_device 1:1 Face Recognition And Liveness detection；1:N & M:N Face Search SDK 。 🧒 离线版设备端Android1:1人脸识别 动作活体检测，静默活体检测 以及1:N M:N 人脸搜索 SDK 封装

    Language:Java5601055111
  • ONE

    Samsung/ONE

    On-device Neural Engine

    Language:C++446452.6k159

  • mit-han-lab/amc

    [ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

    Language:Python4361725115

  • Hugo-Dz/on-device-transcription

    A ready-to-use, minimal app that converts any speech into text.

    Language:JavaScript3573127

  • gkonovalov/android-vad

    Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.

    Language:C27692762
  • aub.ai

    BrutalCoding/aub.ai

    AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

    Language:Dart241121721

  • xliucs/MTTS-CAN

    Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)

    Language:Python17583557

  • mit-han-lab/amc-models

    [ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

    Language:Python16610027

  • hollance/coreml-training

    Source code for my blog post series "On-device training with Core ML"

    Language:Jupyter Notebook1008411

  • ubicomplab/rppg-web

    This is a web demo for camera-based PPG sensing (rPPG).

    Language:TypeScript715515

  • Picovoice/pico-cookbook

    Recipes for on-device voice AI and local LLM

    Language:JavaScript70766

  • neuralize-ai/edgerunner

    Simplified AI runtime integration for mobile app development

    Language:C++652334

  • mit-han-lab/bnn-icestick

    Binary Neural Network on IceStick FPGA.

    Language:Jupyter Notebook505012

  • neuralize-ai/edgerunner-android

    Kotlin bindings for Edgerunner

    Language:Kotlin30100

  • DaemonLoki/MyAppleIntelligence

    Custom implementation of Apple Intelligence features

    Language:Swift290

  • jeho-lee/Awesome-Efficient-AI

    13201

  • roboflow/inference-server-old

    Object detection inference with Roboflow Train models on NVIDIA Jetson devices.

    Language:JavaScript132033
  • mytag

    cryptoboid/mytag

    A Google Photos alternative, where your pictures never leave your phone! Classification happens on-device, leveraging pre-trained models. Available for Android and iOS.

    Language:JavaScript122272

  • baochuquan/ios-vad

    iOS Voice Activity Detection (VAD). Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.

    Language:Swift610

  • megh1241/blockset

    BLOCKSET: Efficient out of core tree ensemble inference

    Language:C++6201

  • volverjs/ai

    Hugging Face Transformers.js wrapper for on-device AI with web-workers

    Language:TypeScript60

  • Michaelgathara/gemini-rec-search

    Rediscover the web by browsing the web and get recommendations of new webpages to explore - powered by Gemini Nano

    Language:TypeScript41

  • Dcom-KHU/AEye-Android

    2022 D.Com 동아리 대항전 Team "AEye" - Android Native App 개발을 위한 Repo.

    Language:Kotlin3200

  • hav4ik/eyesight

    A python framework for designing high-performance Computer Vision pipelines at the Edge. Supports Coral Edge TPU, Raspberry Pi Camera, and more.

    Language:Python3300

  • luix/SponsorMe

    SponsorMe is a project to help provide access to digital tools for learning, powered by on-device machine learning, innovation and willingness, to those people that have limited access to technology due to demographics, disabilities, economy or other multiple reasons.

    Language:Kotlin3100

  • Nokia-Bell-Labs/data-channel-extension

    DEX: Data Channel Extension for Efficient CNN Inference on Tiny AI Accelerators

    Language:Jupyter Notebook2

  • RionDsilvaCS/research-assistant-rag-fusion

    This project implements a complete offline RAG-Fusion application for text generation and retrieval, leveraging efficient local resources.

    Language:Python2

  • ivelin/fall-detection

    Python ML library for person fall detection. Intended for IoT deployments with on-device inference and on-device transfer learning.

    Language:Jupyter Notebook1100

  • nagababumo/-on-device-AI

    Language:Jupyter Notebook1100

  • afondiel/awesome-smol

    An awesome list of "small but mighty" models and resources.

  • Shubh-Bharadwaj/on-device-AI

    Language:Python