anyscale/llm-continuous-batching-benchmarks

OpenCoast

China

Institute of Computing Technology

Ifun Game

https://github.com/kakaobrain

PRIS

@TensorChord

Meituan

ByteDance

@NAVER

@carrierdb

Mountain View, CA

Duke University

Shanda Group

Hong Kong

@kwai

@naver

@naver

Cresta

StepFUN

Microsoft Research

Tsinghua University

Microsoft