This project provides an interface for running a Discord bot powered by a local Large Language Model (LLM). The bot allows users to interact with the model through direct messages and provides a real-time response mechanism.
- Improve history system.
A lightweight Discord bot interface for interacting with locally-hosted language models. Supports conversation history, streaming responses, and custom configurations.
PythonGPL-3.0