tensorchord/modelz-llm

feat: Support embedding API

Closed this issue · 2 comments

gaocegege commented

Support this API: https://platform.openai.com/docs/api-reference/embeddings/create

Several endpoints:

  • /engines/*/embeddings
  • /v1/engines/*/embeddings
  • /embeddings
  • /v1/embeddings
tddschn commented

engines routes are deprecated, do we need to support them? https://platform.openai.com/docs/api-reference/engines
And those routes requires engine_id, what should engine_ids be?

gaocegege commented

Yeah we should support it because openai python SDK still uses it.

  • 👍1