rodjjo/bottled-ai

A chat bot using various LLM models. It runs locally using your own GPU and/or CPU.

bottled-ai

Storyteller

Description

This is a chatbot that runs locally using your GPU (GPTQ models) or CPU (GGML models). It supports several models, and more models are going to be added soon.

Main window

Model downloader

Installation

Platforms:

• Windows - There is an installer here: Latest Release (windows)
• Linux - Work In Progress
• Mac - Future (Maybe)

Note: Do not install inside Program files or other directory that requires admin access to write. The program download models inside its directory.

Other Release

Build and run

Before start make sure you have 7zip, cmake, python 3.10 and Conan 1.59.0 installed.
The build.py script will download the toolset and all the dependencies.

Building the project

python devtools/build.py

Clear the build files and build it again

python devtools/rebuild.py

Run the project

# run:
python devtools/run.py --copy-stuff
# build and run:
python devtools/run.py --build --copy-stuff

Credits

FLTK

• User-Interface