An attempt to use the koboldcpp API with a simple discord chatbot.
This is very much a work in progress, and made for fun.
responds only to the bot name you give it or @<bot>.
Clone or copy the repository.
Rename the .env.example to .env and change its parameters.
On the target computer, run koboldcpp and THEN the main.py file.
9
Your mileage may vary depending on your Large Language Model, instruct prompts, and samples, please adjust them accordingly to your liking.
Personally, I don't recommend models tuned on roleplay if you want a general chatbot, but you do you.
Best used if you have knowledge on Python, AI LLMs, instruct mode, and koboldcpp.
customizable
memory / chat history remembrance
commands (kinda)
Uses Python 3.12.2