Any hint or doc to list all APIs supported in tgi-gaudi?
Ruoyu-y opened this issue · 4 comments
Ruoyu-y commented
I tried the api supported in tgi main branch '/v1/completions' on gaudi-tgi instance and found no response.
Any place to find the APIs that is currently available in tgi-gaudi?
regisss commented
Can you link to '/v1/completions' please? I cannot find it anywhere.
Ruoyu-y commented
Can you link to '/v1/completions' please? I cannot find it anywhere.
It is listed in the TGI API documentation here https://huggingface.github.io/text-generation-inference/#/Text%20Generation%20Inference/completions
regisss commented
This was added in TGI v1.3 and we are going to support it soon.
There might be a bit of latency at times between releases of TGI and the moment we catch up on Gaudi.