A simple app to chat with an LLM which can be used to create any LLM Inference Web Apps using Python only.
This particular app uses OpenAI's GPT-4 API to generate responses to your messages. You can easily change the code to use any other API or model.
A tutorial on how to create this app is available in the Taipy documentation
You need an OpenAI account with an active API key
- Clone this repo:
git clone https://github.com/Avaiga/demo-llm-chat.git
- Install dependencies:
pip install -r requirements.txt
- Run the app using your API key as an argument:
python main.py sk-XXXXX...XXXXX
(You can also set the OPENAI_API_KEY
environment variable instead of passing it as an argument)