/tgi-demo

A demo of high throughput llm serving with TGM

Primary LanguagePython

Watchers