Pinned Repositories
awesome-sglang
Make SGLang go brrr
genai-bench
Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
ome
OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
rbg
sgl-kernel-npu
SGLang kernel library for NPU
sgl-learning-materials
Materials for learning SGLang
sgl-project.github.io
This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
sglang
SGLang is a fast serving framework for large language models and vision language models.
sglang-jax
JAX backend for SGL
SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
sgl-project's Repositories
sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
sgl-project/sgl-learning-materials
Materials for learning SGLang
sgl-project/SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
sgl-project/ome
OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
sgl-project/genai-bench
Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
sgl-project/sgl-project.github.io
This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
sgl-project/sgl-kernel-npu
SGLang kernel library for NPU
sgl-project/sglang-jax
JAX backend for SGL
sgl-project/awesome-sglang
Make SGLang go brrr
sgl-project/rbg
sgl-project/DeepGEMM
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
sgl-project/tensorrt-demo
TensorRT LLM Benchmark Configuration
sgl-project/sgl-flash-attn
Fast and memory-efficient exact attention
sgl-project/whl
Kernel Library Wheel for SGLang
sgl-project/sgl-whl
SGLang wheels for multiple platforms
sgl-project/sgl-kernel-xpu
SGLang kernel library for Intel XPU
sgl-project/llama-stack-evals
Functional tests and benchmarks for verifying Llama model providers.
sgl-project/sgl-test-files
The test files for SGLang.
sgl-project/ci-data