SciSharp/LLamaSharp

Write an API to allow setting stop sequence to use with Kernel Memoery

darcome opened this issue · 0 comments

This is to stop the response of the LLM to a question about own documents after the right answer.

As stated by @AsakusaRinne on Discord,

"Unfortunately it's an issue in kernel memory, see microsoft/kernel-memory#137. Don't worry, we'll wait for the response from kernel-memory at first. If they do not want to change it, we'll add an API to allow setting stop-sequence, though it may be a little inconvenient."