Systemprompt is fixed after the first question.
Opened this issue · 1 comments
emsi commented
The system prompt, providing the context information from the vector store, is fixed after the first question therefore to answer different question, requiring different context one has to reload the interface (there is only one call to system_message endpoint).
Example conversation looks like this:
Q: What is the ranking algorithm?
A: There are several ranking algorithms mentioned in the provided context, so here is a summary of each:
.... yada yada yada
Q: What is the project license?
A: The provided context does not mention the project license.
Reload the interface:
Q: What is the project license?
A: The project license is the GNU Affero General Public License, version 3 or later.
Q: What is the ranking algorithm?
A: There is no mention of a ranking algorithm in the provided context. The context only provides information about the
GNU Affero General Public License and its definitions, as well as information about patent licenses.
mtenenholtz commented
Every new query should pull in new context. The decision to keep the system prompt itself fixed was a design decision that helps a lot of questions that are tangentially related to the initial question, but clearly doesn't work as well when you ask a completely different question. Seems like something that should be toggleable by the user.