aurelio-labs/semantic-router

Error in 05-local-execution on MacOS

Closed this issue · 3 comments

Trying to run /docs/05-local-execution.ipynb notebook on Mac throws the following error:

TypeError: Llama.create_chat_completion() missing 1 required positional argument: 'self'

When running:

out = rl("what's the time in New York right now?")
print(out)
get_time(**out.function_call)

Seems like a LangChain llama-cpp-python error

llm in LlamaCppLLM is set to llama_cpp.Llama here, but create_chat_completion() is not a class method.

Thanks for the spot @mafs12 , seems like this bug was introduced by #190. Working on a fix