ggerganov's Stars
karpathy/llm.c
LLM training in simple, raw C/CUDA
karpathy/minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
google/magika
Detect file content types with deep learning
reorproject/reor
Private & local AI personal knowledge management app for high entropy people.
google/gemma.cpp
lightweight, standalone C++ inference engine for Google's Gemma models.
nilsherzig/LLocalSearch
LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.
alexpinel/Dot
Text-To-Speech, RAG, and LLMs. All local!
huggingface/huggingface.js
Utilities to use the Hugging Face Hub API
yusufcanb/tlm
Local CLI Copilot, powered by CodeLLaMa. 💻🦙
intel/openvino-plugins-ai-audacity
A set of AI-enabled effects, generators, and analyzers for Audacity®.
nkasmanoff/pi-card
Raspberry Pi Voice Assistant
distantmagic/paddler
Stateful load balancer custom-tailored for llama.cpp 🏓🦙
abgulati/LARS
An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
ngxson/wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
EtherDream/headphone-morse-transmitter
Send Morse code via ⏮️ ⏸️ ⏯️
AndrewVeee/nucleo-ai
An AI assistant beyond the chat box.
Daivuk/PureDOOM
Pure DOOM - Single Header Doom Source Port
AlexBuz/llama-zip
LLM-powered lossless compression tool
tangledgroup/llama-cpp-wasm
WebAssembly (Wasm) Build and Bindings for llama.cpp
edgenai/llama_cpp-rs
High-level, optionally asynchronous Rust bindings to llama.cpp
futo-org/whisper-acft
fairydreaming/farel-bench
Testing LLM reasoning abilities with family relationship quizzes.
AIWintermuteAI/whispercpp
Pybind11 bindings for Whisper.cpp
ahoylabs/gguf.js
A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
distantmagic/structured
Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp
okuvshynov/llama_duo
asynchronous/distributed speculative evaluation for llama3
hyparam/hyllama
llama.cpp gguf file parser for javascript
Artefact2/llm-eval
A super simple web interface to perform blind tests on LLM outputs.
Mihaiii/trivia
A live multiplayer trivia game where users can bid for the subject of the next question
astrowonk/emoji_finder
emoji_finder