feature: support for FIM tokens
Opened this issue · 1 comments
famiu commented
Feature request
Support for FIM tokens. Here is an example of FIM tokens used in Codegemma: https://github.com/huggingface/blog/blob/main/codegemma.md#prompt-format
Ideally, the FIM tokens should be configurable since different LLMs use different FIM tokens.
Motivation
Currently, avante.nvim does not seem to support FIM tokens, which makes it impossible (in my experience) to use Ollama for auto_suggestions_provider. Adding FIM token support will make it possible.
https://github.com/meeehdi-dev/bropilot.nvim is an example of a plugin that implements FIM support.
Other
No response
yetone commented
Thank you for sharing, I will look into it.