EleutherAI/gpt-neox

Add basic Mamba block

Quentin-Anthony opened this issue · 0 comments

We want to add Mamba to gpt-neox: