zilliztech/akcio

Memory problem of the bot

lydacious opened this issue · 2 comments

Hello, so I am using a unique session ID and I am using PostgreSQL for memory. The thing is I don't see how I should set it up so that the bot uses the chat_history for context. For example, I will ask the bot to call me Lydacious and in my next message it will say "Unfortunately, I couldn't find any information about what you asked me to call you earlier.". I don't know if it is relative but in my prompt, I've made sure so the bot never comes up with new answers, only takes them from the doc chunks that have been provided.

Akcio automatically includes chat history up to a pre-set limit. The problem might be due to your change on the prompt. Can you test whether it works as intended with the out-of-box prompt? If so, the problem is likely in the change on the prompt.

Akcio automatically includes chat history up to a pre-set limit. The problem might be due to your change on the prompt. Can you test whether it works as intended with the out-of-box prompt? If so, the problem is likely in the change on the prompt.

Do you know in which line or file it gets included? I have tried it with default prompt as well but it was the same. Also, I have created a telegram bot that uses the API to talk to Akcio. Basically, the users talk to Akcio via a telegram bot. I don't know if that is relevant though.