sgl-project/sglang

[Feature] Jamba 1.5 Support PLS

nivibilla opened this issue · 1 comments

Checklist

Motivation

First SOTA ssm based model, vllm currently supports it but there is some parallel work in vllm to optimise it aswell

https://huggingface.co/collections/ai21labs/jamba-15-66c44befa474a917fcf55251

Related resources

vllm implementation
vllm-project/vllm#4115

We would love to have this model. Contributions are welcome!