InftyAI/llmlite

Support fall back across several providers

kerthcet opened this issue · 11 comments

For example: when calling OpenAI failed, fall back to other providers like VertexAI

/kind feature

Also including retry logics.

/close

/reopen

/retitle Support fall back across several providers

/priority important-longterm

/milestone v0.0.16

/milestone v0.0.16

/milestone clear

/retitle Support fall back across several providers

/triage needs-information