TensorRT-LLM server with Structured Outputs (JSON) built with Rust
Primary LanguageRustMIT LicenseMIT