Simple Telegram bot AI Assistant using llama-cpp-python
How to install
pip install python-telegram-bot --upgrade
pip install llama-cpp-python
git clone https://github.com/Rotyxium/probable-octo-guide.git
Request your bot with the Bot Godfather in the Telegram bot open the chatbot.py with your IDE change the TELEGRAM_TOKEN with your token and model_path to your model path, the model must be GGML because I'm using llama-cpp-python here, if you have different type for example GPTQ model, you need to change the generate_response function and the Model loader with whatever type your of model is or if you use oobabooga's text generation web ui use their api
Run