local-llm

There are 47 repositories under local-llm topic.

  • anything-llm

    Mintplex-Labs/anything-llm

    The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

    Language:JavaScript16.5k1351.2k1.7k
  • langroid

    langroid/langroid

    Harness LLMs with Multi-Agent Programming

    Language:Python1.9k17145180

  • lxe/llavavision

    A simple "Be My Eyes" web app with a llama.cpp/llava backend

    Language:JavaScript4707230

  • withcatai/catai

    Run AI ✨ assistant locally! with simple API for Node.js 🚀

    Language:TypeScript422104427

  • shreyaskarnik/DistiLlama

    Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. 🔐

    Language:TypeScript2435226

  • nath1295/LLMFlex

    A python package for developing AI applications with local LLMs.

    Language:Python1317014

  • AstraBert/everything-ai

    Your fully proficient, AI-powered and local chatbot assistant🤖

    Language:Python106806

  • Fus3n/TwoAI

    A simple experiment on letting two local LLM have a conversation about anything!

    Language:Python783010

  • xtekky/gpt4local

    Openai-style, fast & lightweight local language model inference w/ documents

    Language:Python674017

  • gsuuon/ad-llama

    Structured inference with Llama 2 in your browser

    Language:TypeScript47212

  • Picovoice/pico-cookbook

    Recipes for on-device voice AI and local LLM

    Language:Java44613
  • llm-axe

    emirsahin1/llm-axe

    A simple, intuitive toolkit for quickly implementing LLM powered applications.

    Language:Python437

  • ShelbyJenkins/llm_client

    Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.

    Language:Rust40313

  • edgett/PalmHill.BlazorChat

    PalmHill.BlazorChat is a chat application and API built with Blazor WebAssembly, SignalR, and WebAPI, featuring real-time LLM conversations, markdown support, customizable settings, and a responsive design. This project supports Llama2 models and was tested with Orca2.

    Language:C#26225

  • Fus3n/infinite-sides

    Infinite Craft but in Pyside6 and Python with local LLM (llama2 & others) using Ollama

    Language:Python262

  • datacrystals/AIStoryWriter

    LLM story writer with a focus on high-quality long output based on a user provided prompt.

    Language:Python16

  • J4NN0/llm-rag

    LLMs prompt augmentation with RAG by integrating external custom data from a variety of sources, allowing chat with such documents

    Language:Python12415

  • potproject/uchinoko-studio

    Uchinoko Studio is a web application designed to facilitate real-time voice conversations with AI.

    Language:Svelte11200

  • lennartpollvogt/ollama-instructor

    Instruct and validate structured outputs from LLMs with Ollama.

    Language:Python10

  • TinToSer/GPT4Docs

    An Offline Document Enquiry LLM for Everyone

    Language:Python10214

  • Likhithsai2580/JARVIS

    Project Jarvis is a versatile AI assistant that integrates various functionalities.

    Language:Python7100

  • kpcyrd/summarize-cli

    Attempt to summarize text from `stdin`, using a large language model (locally and offline), to `stdout`

    Language:Rust6303

  • h1ddenpr0cess20/ollamarama

    Terminal based AI chatbot with infinite personalities, using local LLMs

    Language:Python4201

  • lori-assistant/frontend

    User interface for a ChatGPT-like chatbot powered by a local Ollama AI server, with support for plugins in the future

    Language:Dart4200

  • Govind-S-B/ppt_generator

    A local LLM assisted ppt generation tool

    Language:Python3343

  • Abhi5h3k/LLQuery

    LLQuery : Your Conversational SQL Bridge Harness the power of natural language to effortlessly craft SQL queries with LLQuery.

    Language:Python20

  • boshyxd/DiscordLLM

    Run state-of-the-art language models locally. Chat with AI using simple slash commands. Zero cloud, zero cost – just pure, home-brewed AI magic.

    Language:Python2

  • dmeldrum6/LocalLLMChat

    Serverless single HTML page access to an OpenAI API compatible Local LLM

    Language:HTML2

  • gustavostz/Local-AI-Open-Orca-For-Dummies

    Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!

    Language:Python2100

  • harehimself/crewai-local-llm

    CrewAI Local LLM is a GitHub repository for a locally hosted large language model (LLM) designed to enable private, offline AI model usage and experimentation.

    Language:Python2200

  • kristofferv98/SemanthaVoiceAssistant

    A comprehensive AI companion leveraging advanced semantic analysis, sentiment detection, and voice processing to provide personalized and context-aware interactions using Autogen, semantic-router, and VoiceProcessingToolkit.

    Language:Python20

  • manthan89-py/DataWhisperer

    Data Whisperer is a chatbot that allows you to analyze your local files using Large Language Models (LLMs). You can upload PDFs, Markdown, Text, and Document files to the chatbot and then ask questions related to the content of these files.

    Language:Python220

  • macie/boludo

    Terminal UI for locally hosted large language models

    Language:Go1300

  • MOONLAPSED/cognOS

    Python package for cognosis kb, syntax, and markup language. Under-construction.

    Language:Python10

  • gdifiore/askdotmd

    chatgpt in your vscode

    Language:TypeScript0100

  • alexkreidler/quote-constraint

    A constrained generation filter for local LLMs that makes them quote properly from a source document

    Language:Python