NetEase-Media/grps
【深度学习模型部署框架】支持tf/torch/trt/trtllm/vllm以及更多nn框架,支持dynamic batching、streaming模式,支持python/c++双语言,可限制,可拓展,高性能。帮助用户快速地将模型部署到线上,并通过http/rpc接口方式提供服务。
C++Apache-2.0
Stargazers
- 18321961708
- 810FC003HRG
- aweklingBitMain
- backeyzhang
- bjcodereview14
- cod2sFull Duplex
- CodingSunhj
- DorothyRazo
- huolAlAlADavis, California
- iEnthusiasm
- jwshang
- lonyee1989
- Lycokie@Google
- mazouriBaidu
- MinerPr0xy
- nap1chSNH
- PaulMiller87Meta
- plag-it-hubLuoHe
- qiongbeInvincible Planck
- quitozang
- qzh131
- Reyx3CSDN
- rocketballsnetease
- RockNetyLitecoin
- sflowing
- SmileYuHo
- thevinaT-Y-T-O
- UMRKawhiIndianapolis, IN
- UnknownCUnknownNUPT
- winc-link
- xuchengsheng
- yafanisonya
- yujiaaoyu
- ZhaiMing0Beijing
- zhaocc1106Baidu, Netease
- Zone-Fun新世界