Grok-1 Tool Support
Opened this issue · 1 comments
ngoiyaeric commented
Current open source Grok does not support function calling.
https://x.ai/blog/grok-os
Do you guys have any backend for loading open source language models into your stack, something like ollama or llocal.
alt-glitch commented
Yes, we can add support for other models hosted through ollama/replicate etc.
As for tool calls, it is possible to set/add a flag like add_function_to_prompt = True which would then prompt the model to use the function calling spec and return the JSON of the tool call.