baaivision/JudgeLM

HuggingFace TGI for fast inference and serving

ogencoglu opened this issue · 2 comments

ogencoglu commented

Do you models support HuggingFace TGI for fast serving?

Unrealluver commented

Thanks for your interest, but the JudgeLM does not support that yet. :(

ogencoglu commented

Alright, thanks for the reply!