ggerganov's Stars
karpathy/llm.c
LLM training in simple, raw C/CUDA
karpathy/minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
google/magika
Detect file content types with deep learning
reorproject/reor
Private & local AI personal knowledge management app.
google/gemma.cpp
lightweight, standalone C++ inference engine for Google's Gemma models.
nilsherzig/LLocalSearch
LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.
huggingface/huggingface.js
Utilities to use the Hugging Face Hub API
alexpinel/Dot
Text-To-Speech, RAG, and LLMs. All local!
yusufcanb/tlm
Local CLI Copilot, powered by CodeLLaMa. 💻🦙
intel/openvino-plugins-ai-audacity
A set of AI-enabled effects, generators, and analyzers for Audacity®.
nkasmanoff/pi-card
Raspberry Pi Voice Assistant
distantmagic/paddler
Stateful load balancer custom-tailored for llama.cpp
AndrewVeee/nucleo-ai
An AI assistant beyond the chat box.
Daivuk/PureDOOM
Pure DOOM - Single Header Doom Source Port
pythops/tenere
🔥 TUI interface for LLMs written in Rust
ngxson/wllama
WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
AlexBuz/llama-zip
LLM-powered lossless compression tool
EtherDream/headphone-morse-transmitter
Send Morse code via ⏸️ ⏯️ ⏮️
tangledgroup/llama-cpp-wasm
WebAssembly (Wasm) Build and Bindings for llama.cpp
edgenai/llama_cpp-rs
High-level, optionally asynchronous Rust bindings to llama.cpp
futo-org/whisper-acft
mtx512/rk3588-npu
Reverse engineering the rk3588 npu
QuantiusBenignus/blurt
Gnome shell extension for accurate speech to text input in Linux using whisper.cpp. Input text from speech anywhere.
ahoylabs/gguf.js
A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
distantmagic/structured
Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp
okuvshynov/llama_duo
asynchronous/distributed speculative evaluation for llama3
AIWintermuteAI/whispercpp
Pybind11 bindings for Whisper.cpp
Artefact2/llm-eval
A super simple web interface to perform blind tests on LLM outputs.
hyparam/hyllama
llama.cpp gguf file parser for javascript
astrowonk/emoji_finder
emoji_finder