PygmalionAI/aphrodite-engine

[Feature]: Support [RecurrentGemmaForCausalLM]

Opened this issue ยท 3 comments

๐Ÿš€ The feature, motivation and pitch

I want use recurrentGemma in aphrodite-engine

ValueError: Model architectures ['RecurrentGemmaForCausalLM'] are not supported for now.

Alternatives

No response

Additional context

No response

It's definitely planned. I haven't looked at the architecture yet, but I assume it's RNN-based, so #419 would probably make ways for it.

We have a lot more to work on at the moment, so this may take a while.

It's definitely planned. I haven't looked at the architecture yet, but I assume it's RNN-based, so #419 would probably make ways for it.

We have a lot more to work on at the moment, so this may take a while.

Thank you. Take care of yourself.

Please keep the issue open for tracking purposes.