microsoft/TransformerCompression

Command R and R+ support

Steel-skull opened this issue · 1 comments

Hello! first off thanks for the hard work!

is there plans to add Command R and R+ support?

I am attempting too but im a little out of my depth.

Thanks again!

Hi @Steel-skull, thanks for asking - we're looking into MoEs, watch this space!