edge-ai
There are 218 repositories under edge-ai topic.
FedML-AI/FedML
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
beclab/Olares
Olares: An Open-Source Personal Cloud to Reclaim Your Data
mit-han-lab/once-for-all
[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment
sipeed/MaixPy-v1
MicroPython for K210 RISC-V, let's play with edge AI easier
DT42/BerryNet
Deep learning gateway on Raspberry Pi and other edge devices
Picovoice/speech-to-text-benchmark
speech to text benchmark framework
anilsathyan7/Portrait-Segmentation
Real-time portrait segmentation for mobile devices
sipeed/MaixPy
Easily create AI projects with Python on edge device
Azure/AI-in-a-Box
AI-in-a-Box leverages the expertise of Microsoft across the globe to develop and provide AI and ML solutions to the technical community. Our intent is to present a curated collection of solution accelerators that can help engineers establish their AI/ML environments and solutions rapidly and with minimal friction.
mit-han-lab/tiny-training
On-Device Training Under 256KB Memory [NeurIPS'22]
qijianpeng/awesome-edge-computing
A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.
hailo-ai/hailo_model_zoo
The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment
sony/model_optimization
Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.
microsoft/nn-Meter
A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.
magic-blue-smoke/Dual-Edge-TPU-Adapter
Dual Edge TPU Adapter to use it on a system with single PCIe port on m.2 A/B/E/M slot
F33RNI/GPT-Telegramus
đź’ś The best free Telegram bot for ChatGPT, Microsoft Copilot (aka Bing AI / Sidney / EdgeGPT), Microsoft Copilot Designer (aka BingImageCreator), Gemini and Groq with stream writing, requests with images, multiple languages, admin control, data logging and more!
dusty-nv/NanoLLM
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
bdtinc/maskcam
Jetson Nano-based smart camera system that measures crowd face mask usage in real-time.
galliot-us/neuralet
Neuralet is an open-source platform for edge deep learning models on edge TPU, Jetson Nano, and more.
GetSoloTech/solo-server
Server for Physical AI Inference
FaceOnLive/Spleeter-Android-iOS
On-device, Offline Spleeter Solution For Mobile
Lizonghang/TPI-LLM
TPI-LLM: Serving 70b-scale LLMs Efficiently on Low-resource Edge Devices
sipeed/MaixPy3
Python sdk for Sipeed Maix-II-Dock(v831). Other board please use https://github.com/sipeed/MaixPy
scaleoutsystems/fedn
An enterprise-ready and vendor-agnostic federated learning platform.
hailo-ai/tappas
High-performance, optimized pre-trained template AI application pipelines for systems using Hailo devices
galliot-us/smart-social-distancing
Social Distancing Detector using deep learning and capable to run on edge AI devices such as NVIDIA Jetson, Google Coral, and more.
edge-video-services/ekya
Source code and datasets for Ekya, a system for continuous learning on the edge.
hailo-ai/hailort
An open source light-weight and high performance inference framework for Hailo devices
ShawnHymel/tflite-speech-recognition
Demo for training a convolutional neural network to classify words and deploy the model to a Raspberry Pi using TensorFlow Lite.
PIC4SeR/AcT
Official code for "Action Transformer: A Self-attention Model for Short-time Pose-based Human Action Recognition", Pattern Recognition (2022).
wangxb96/Awesome-EdgeAI
Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"
intel-iot-devkit/people-counter-python
Create a smart video application using the Intel Distribution of OpenVINO toolkit. The toolkit uses models and inference to run single-class object detection.
otroshi/edgeface
EdgeFace: Efficient Face Recognition Model for Edge Devices [TBIOM 2024] the winner of compact track of IJCB 2023 Efficient Face Recognition Competition
borhanMorphy/fastface
Light Face Detection using PyTorch Lightning
intel-iot-devkit/smart-retail-analytics
Use computer vision inference in the Intel® Distribution of OpenVINO™ toolkit to provide analytics on customer engagement, store traffic, and shelf inventory.
intel-iot-devkit/people-counter-cpp
Create a smart video application using the Intel Distribution of OpenVINO toolkit. The toolkit uses models and inference to run single-class object detection.