Context Length Option With File Context Enabled Doesn't Limit Length
Closed this issue · 1 comments
anaseinea commented
Describe the bug
Context Length Option With File Context Enabled Doesn't Limit Length of FIM sent
To Reproduce
Enable File Context option and set Context Length then use FIM and check number of lines sent
API Provider
Ollama
Chat or Auto Complete?
FIM
rjmacarthy commented
Hey thanks, this is a duplicate of #23 which is basically a task to adhere to LLM context window. We need to know the context window size and tokeniser for each LLM being used it is not a trivial task and the context enabled feature is pretty much experimental.