Add LMStudio adapter
Tomas2D opened this issue · 2 comments
Tomas2D commented
Add LLM inference support for https://lmstudio.ai/
Implementation notes:
- Use appropriate SDK: https://github.com/lmstudio-ai/lmstudio.js
- Target directory:
src/adapters/lmstudio
with filesllm.ts
andchat.ts
. - Add tests
Implementation tips:
- Implementation should be similar to the current Ollama (
src/adapters/ollama
).
JanPokorny commented
Note that it's currently possible to use LM Studio with Bee through the OpenAI-compatible API (https://lmstudio.ai/docs/basics/server#openai-like-api-endpoints), in a similar way to Ollama. I haven't checked if it has limitations over the SDK, however.
Tomas2D commented
Then I wonder why their SDK (https://www.npmjs.com/package/@lmstudio/sdk) differs from Ollama / OpenAI SDK.