Nous Hermes Llama-2 13B Bot

Chatbot powered by the Nous-Hermes-Llama2-13B model.

How do I run this myself?

Refer to the quick start for general instructions on how to create server bots and deploy them on modal.com
In Modal, create a secret named nous-hermes-l2-13b-secret containing both your TOGETHER_API_KEY (obtainable by signing up at together.ai) and the POE_ACCESS_KEY you wish to use.
Run modal serve main.py
Create a bot on poe.com and provide your server url and access key.