/openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend

Primary LanguageRustMIT LicenseMIT

Watchers

No one’s watching this repository yet.