Future-House/paper-qa

`LLMModel` does not support tool calling

Opened this issue · 0 comments

It would be nice if LLMModel directly supported tool calling.

That way, we wouldn't need to shim to aviary.ToolSelector like we do here:

paper-qa/paperqa/llms.py

Lines 757 to 764 in 6fda922

async def select_tool(
self, *selection_args, **selection_kwargs
) -> ToolRequestMessage:
"""Shim to aviary.core.ToolSelector that supports tool schemae."""
tool_selector = ToolSelector(
model_name=self.name, acompletion=self.router.acompletion
)
return await tool_selector(*selection_args, **selection_kwargs)