yetone/avante.nvim

feature: support for FIM tokens

Opened this issue · 1 comments

famiu commented

Feature request

Support for FIM tokens. Here is an example of FIM tokens used in Codegemma: https://github.com/huggingface/blog/blob/main/codegemma.md#prompt-format

Ideally, the FIM tokens should be configurable since different LLMs use different FIM tokens.

Motivation

Currently, avante.nvim does not seem to support FIM tokens, which makes it impossible (in my experience) to use Ollama for auto_suggestions_provider. Adding FIM token support will make it possible.

https://github.com/meeehdi-dev/bropilot.nvim is an example of a plugin that implements FIM support.

Other

No response

‌‌‌‌‌‌‌Thank you for sharing, I will look into it.