llamacpp
There are 542 repositories under llamacpp topic.
menloresearch/jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
khoj-ai/khoj
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
llmware-ai/llmware
Unified framework for building enterprise RAG pipelines with small, specialized models
getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
xorbitsai/inference
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
reorproject/reor
Private & local AI personal knowledge management app for high entropy people.
LostRuins/koboldcpp
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
serge-chat/serge
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
JohnSnowLabs/spark-nlp
State of the Art Natural Language Processing
gptme/gptme
Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web, vision.
gpustack/gpustack
Simple, scalable AI model deployment on GPU clusters
twinnydotdev/twinny
The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but 100% free.
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
Josh-XT/AGiXT
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
cactus-compute/cactus
Run AI locally on phones and AI-native devices
SilasMarvin/lsp-ai
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
menloresearch/cortex.cpp
Local AI API Platform
Mobile-Artificial-Intelligence/maid
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
floneum/floneum
Instant, controllable, local pre-trained AI models in Rust
alexpinel/Dot
Text-To-Speech, RAG, and LLMs. All local!
alexrozanski/LlamaChat
Chat with your favourite LLaMA models in a native macOS app
mostlygeek/llama-swap
Model swapping for llama.cpp (or any local OpenAI API compatible server)
RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
intentee/paddler
Open-source LLMOps platform for hosting and scaling AI in your own infrastructure 🏓🦙
vercel/modelfusion
The TypeScript library for building AI applications.
awaescher/OllamaSharp
The easiest way to use Ollama in .NET
Michael-A-Kuykendall/shimmy
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
benman1/generative_ai_with_langchain
Build production-ready LLM applications and advanced agents using Python, LangChain, and LangGraph. This is the companion repository for the book on generative AI with LangChain.
Dicklesworthstone/swiss_army_llama
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
ngxson/wllama
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
Atome-FE/llama-node
Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
huggingface/llm-ls
LSP server leveraging LLMs for code completion (and more?)
mukel/llama3.java
Practical Llama 3 inference in Java
if-ai/ComfyUI-IF_AI_tools
ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.
Maximilian-Winter/llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.