/open_source_llm_tool_use

Uses pydantic schema and prompting to use tool calling effectively with open source llms (tested with Llama3 using HF inference API)I

Primary LanguagePythonApache License 2.0Apache-2.0

Example use

See app.py for example use.

Set api_type as "ollama", "anthropic", "llama-cpp", "watsonx", "lm-studio" to use the langchain prompt/invocation associated with that provider.

Default api_type is openai and doesn't need to be set.

**Have not tested anthropic, llama-cpp, watsonx, or lm-studio. Ollama and OpenAI working on 5/28/2024.