local-llm

There are 350 repositories under local-llm topic.

  • anything-llm

    Mintplex-Labs/anything-llm

    The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

    Language:JavaScript49.1k3402.8k5.1k
  • langroid

    langroid/langroid

    Harness LLMs with Multi-Agent Programming

    Language:Python3.7k28247349

  • LearningCircuit/local-deep-research

    Local Deep Research achieves ~95% on SimpleQA benchmark (tested with GPT-4.1-mini). Supports local and cloud LLMs (Ollama, Google, Anthropic, ...). Searches 10+ sources - arXiv, PubMed, web, and your private documents. Everything Local.

    Language:Python3.4k25176330
  • openai-edge-tts

    travisvn/openai-edge-tts

    Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

    Language:Python1.3k615188

  • lxe/llavavision

    A simple "Be My Eyes" web app with a llama.cpp/llava backend

    Language:JavaScript4938233

  • withcatai/catai

    Run AI ✨ assistant locally! with simple API for Node.js 🚀

    Language:TypeScript47994533

  • runebookai/tome

    a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP

    Language:Svelte470
  • resume-ai

    resume-llm/resume-ai

    A local, privacy-first résumé builder using LLMs and Markdown to generate ATS-ready DOCX files with Pandoc — no cloud, no tracking.

    Language:TypeScript339

  • shreyaskarnik/DistiLlama

    Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. 🔐

    Language:TypeScript3006434
  • chatterbox-tts-api

    travisvn/chatterbox-tts-api

    Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)

    Language:Python28839

  • rafska/Awesome-local-LLM

    A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

    271
  • llm-axe

    emirsahin1/llm-axe

    A simple, intuitive toolkit for quickly implementing LLM powered applications.

    Language:Python26551636

  • deveix/react-native-apple-llm

    React Native Apple LLM plugin using Foundation Models

    Language:Swift260
  • vscode-reborn-ai

    vscode-reborn-ai/vscode-reborn-ai

    Code with AI in VSCode, bring your own ai.

    Language:TypeScript25869347

  • AstraBert/everything-ai

    Your fully proficient, AI-powered and local chatbot assistant🤖

    Language:Python2468022

  • rockbite/localforge

    Local coding agent with neat UI

    Language:JavaScript246

  • jonigl/mcp-client-for-ollama

    A text-based user interface (TUI) client for interacting with MCP servers using Ollama. Features include multi-server, dynamic model switching, streaming responses, tool management, human-in-the-loop, thinking mode, full model parameters configuration, custom system prompt and saved preferences. Built for developers working with local LLMs.

    Language:Python22537

  • kamjin3086/chatless

    💻一款简洁实用轻量级的本地AI对话客户端，采用Tauri2.0和Next.js编写 A simple, practical, and lightweight local AI chat client, written in Tauri 2.0 & Next.js.

    Language:TypeScript20416

  • datacrystals/AIStoryWriter

    LLM story writer with a focus on high-quality long output based on a user provided prompt.

    Language:Python16733049

  • nath1295/LLMFlex

    A python package for developing AI applications with local LLMs.

    Language:Python1528020

  • sfortis/openai_tts

    Custom TTS component for Home Assistant. Utilizes the OpenAI speech engine or any compatible endpoint to deliver high-quality speech. Optionally offers chime and audio normalization features.

    Language:Python15122136

  • mrkrsl/web-search-mcp

    A simple, locally hosted Web Search MCP server for use with Local LLMs

    Language:TypeScript143

  • xtekky/gpt4local

    Openai-style, fast & lightweight local language model inference w/ documents

    Language:Python1245029

  • daviddaytw/react-native-transformers

    Run local LLM from Huggingface in React-Native or Expo using onnxruntime.

    Language:TypeScript119378

  • BodhiSearch/BodhiApp

    Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

    Language:Rust1165129

  • hydropix/TranslateBookWithLLM

    A python script designed to translate large amounts of text with an LLM and the Ollama API

    Language:Python113

  • Fus3n/TwoAI

    A simple experiment on letting two local LLM have a conversation about anything!

    Language:Python1123115

  • Picovoice/pico-cookbook

    Recipes for on-device voice AI and local LLM

    Language:Python986710

  • Likhithsai2580/JARVIS

    Project Jarvis is a versatile AI assistant that integrates various functionalities.

    Language:Python832117

  • lennartpollvogt/ollama-instructor

    Python library for the instruction and reliable validation of structured outputs (JSON) of Large Language Models (LLMs) with Ollama and Pydantic. -> Deterministic work with LLMs.

    Language:Python76593

  • enescingoz/colab-llm

    This repository provides a ready-to-use Google Colab notebook that turns Colab into a temporary server for running local LLM models using Ollama. It exposes the model API via a secure Cloudflare tunnel, allowing remote access from tools like curl or ROO Code in VS Code — no server setup or cloud deployment required.

    Language:Jupyter Notebook73

  • davideuler/pdf-translator-for-human

    A flexible free and unlimited PDF Translator for Human with Local-LLM or ChatGPT

    Language:Python686

  • edgett/PalmHill.BlazorChat

    PalmHill.BlazorChat is a chat application and API built with Blazor WebAssembly, SignalR, and WebAPI, featuring real-time LLM conversations, markdown support, customizable settings, and a responsive design. This project supports Llama2 models and was tested with Orca2.

    Language:C#675511

  • royshil/note-taker

    A lo-fi AI-first note taker running locally on-device

    Language:Python67

  • Aestheticsuraj234/vibecode-playground

    Vibecode Editor is a fullstack, web-based IDE built with Next.js and Monaco Editor. It features real-time code execution using WebContainers, AI-powered code suggestions via locally running Ollama models, multi-stack templates, an integrated terminal, and a developer-focused UI for seamless coding in the browser.

    Language:TypeScript592022
  • simple-rag

    ParthSareen/simple-rag

    Too many docs? Quickly search over any PDF or Markdown documents

    Language:Python55115