koboldcpp

if-ai/ComfyUI-IF_AI_tools

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.

aseichter2007/ClipboardConqueror

Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.

BBC-Esq/VectorDB-Plugin

Plugin that lets you ask questions about your documents including audio and video files.

jabberjabberjabber/ImageIndexer

Creates an index of images, queries a local LLM and adds tags to the image metadata

lee-b/kobold_assistant

Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper

Nexesenex/croco.cpp

Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compatible with most of Ikawrakow's quants except Bitnet.

latestissue/AltaeraAI

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

badgids/OpenKlyde

An AI Discord bot that connects to a koboldcpp instance by API calls. Have a more intelligent Clyde Bot of your own making!

lone-cloud/gerbil

A desktop app for running Large Language Models locally.

Iteranya/AktivaAI

Local LLM Discord Bot

acrion/ditana-assistant

Ditana Assistant: AI-powered CLI/GUI tool for intelligent assistance, leveraging LLMs with OS interaction capabilities and context augmentation, optionally via Wolfram|Alpha

KJC-Dev/UpperDeckBot

XMPP Bot designed for E2EE AI language model interactions

jabberjabberjabber/Context-Tester

LLM Benchmark

pboardman/KoboldSharp

koboldcpp REST API wrapper for C#

PeterPeet/KLITE-Tools

KLITE-Tools provides UserMods for KoboldAI Lite

Ambruk-chan/DiscordBot

The Ultimate Local LLM Discord Bot!!!

BBC-Esq/VectorDB-Plugin-for-KoboldAI

Basic vector database plugin that works wth KoboldAI. Adds documents, images, and audio files.

outcatcher/SillyTavern-KoboldModelSwitcher-Server

SillyTavern server plugin for running LLMs using KoboldCpp on server

jim3692/koboldcpp-flake

Run Llama 3.1 directly

maxadov/KovalskyAI

🧠 A fully self-hosted, universal AI chat interface powered by local LLMs. Designed for both desktop and laptop use — supports CPU and GPU (CUDA) execution. Features real-time streaming responses, clean minimalist UI, and no external server dependencies. Ideal for building your own private, offline AI assistant.

bunnywaffle/Koboldcpp-Themes

honkyrot/discord-koboldcpp

An attempt to use the KoboldCpp API

Ketis21/KetisBot

KetisBot is a powerful Discord AI chatbot using KoboldCpp for text generation, web browsing, and image creation. It features slash commands for easy interaction and allows admin customization.

946923759/koboldcpp-discord-bot

Discord bot that uses KoboldCPP API and character cards

acrion/ditana-config-logseq

Preconfigured Logseq setup for Ditana Linux with local AI integration using KoboldCpp

futursolo/pai

Collection of AI Containers - Prebuilt and Ready-to-Use

Iteranya/DiscordBot

The Ultimate Local LLM Discord Bot!!!

mrf4nta/koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.