/llama-bot

Primary LanguagePython

llamaBot

Installation

pip install -r requirements.txt
CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python

Usage

python3 main.py