High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
Primary LanguageRustApache License 2.0Apache-2.0