[Feature Request] Integrate `SGlang`
lightaime opened this issue · 0 comments
lightaime commented
Required prerequisites
- I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
- Consider asking first in a Discussion.
Motivation
Integrate SGlang for fast serving.
https://github.com/sgl-project/sglang
Solution
No response
Alternatives
No response
Additional context
No response