[Feature] Jamba 1.5 Support PLS
nivibilla opened this issue · 1 comments
nivibilla commented
Checklist
- 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
- 2. Please use English, otherwise it will be closed.
Motivation
First SOTA ssm based model, vllm currently supports it but there is some parallel work in vllm to optimise it aswell
https://huggingface.co/collections/ai21labs/jamba-15-66c44befa474a917fcf55251
Related resources
vllm implementation
vllm-project/vllm#4115
merrymercy commented
We would love to have this model. Contributions are welcome!