Limit max tokens in response
detrin opened this issue · 0 comments
detrin commented
After searching documentation and --help it seems like there is no way how we can limit the maximum number of output tokens as of now.
https://llm.datasette.io/en/stable/search.html?q=max+tokens&check_keywords=yes&area=default