/sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers