i-am-bee/bee-agent-framework

Add LMStudio adapter

Tomas2D opened this issue · 2 comments

Add LLM inference support for https://lmstudio.ai/

Implementation notes:

Implementation tips:

  • Implementation should be similar to the current Ollama (src/adapters/ollama).

Note that it's currently possible to use LM Studio with Bee through the OpenAI-compatible API (https://lmstudio.ai/docs/basics/server#openai-like-api-endpoints), in a similar way to Ollama. I haven't checked if it has limitations over the SDK, however.

Then I wonder why their SDK (https://www.npmjs.com/package/@lmstudio/sdk) differs from Ollama / OpenAI SDK.