alibaba/llm-scheduling-artifact
Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
PythonApache-2.0
Stargazers
- char-1eeNanyang Technological University
- chenghuaWangI work for myself
- chenwenyancis@um
- czq693497091
- diliu0349Shanghai Jiao Tong University
- DinghowLepton AI
- DTennantShanghai
- gaow0007Nanyang Technological University
- GitHub30Osaka, Japan
- hehesnail
- hkeee21
- Hon-Chen
- JF-DPh.D. Candidate@CUHK-MMLab, B.E.@ UCAS
- JoeyYoungThe University of HongKong
- linzs148
- listenlink
- llx-08Beijing, China
- lumiere-mlShanghai
- m1093782566Walking on the Cloud
- ming-makeUniversity of Chinese Academy of Sciences
- nemo9cbyHuawei Canada
- palhotellikeada
- PannenetsFBeihang University
- s5u13b@AlibabaPAI
- ShawnZhongMadison, Wisconsin
- shengwenliang
- victbr
- warpmatrixSun Yat-sen University
- WencongXiaoAlibaba
- wuzihengAlibaba
- xysmlxMicrosoft Research Asia
- ZeldaHuangBeihang University
- zhukevkeskyUniversity of Science and Technology of China (USTC)
- zhypkuBeijing
- ZiruiOu
- zouxinyi0625