AkeruAI/akeru

Assistant responds to message

GuiBibeau opened this issue · 0 comments

GuiBibeau commented

We need a way to let an assistant respond to a thread.

Blocked by #8 and #11.

Acceptance Criteria:

  • The message endpoint currently is only accepting incoming messages, but does not return assistant messages.
  • Call proper LLM adapter to send the old message and receive the answer. (Don't hard code GPT-4 only. Get the model of the thread from the DB and switch on the right adapter if necessary).
  • Store the answer in the database.
  • Send the answer to the client.
  • Explore elysia streams to stream the answer back. Also request a stream from the GPT-4 API if it's not already one.