Write an API to allow setting stop sequence to use with Kernel Memoery
darcome opened this issue · 0 comments
darcome commented
This is to stop the response of the LLM to a question about own documents after the right answer.
As stated by @AsakusaRinne on Discord,
"Unfortunately it's an issue in kernel memory, see microsoft/kernel-memory#137. Don't worry, we'll wait for the response from kernel-memory at first. If they do not want to change it, we'll add an API to allow setting stop-sequence, though it may be a little inconvenient."