Add more options for ollama
Opened this issue · 0 comments
mdietrich16 commented
I would love move options for using ollama, like the keep_alive
to load models indefinitely or unload them immediately or the context size for the model. These additional options are specified in the ollama github and some can be set via a dedicated modelfile, but a lot of times I would want a single-shot parameter addition and not yet another modelfile, which also clutters the list of models.