sustcsonglin/flash-linear-rnn

Implementations of various linear RNN layers using pytorch and triton

Linear RNN Layer Zoo in Pytorch

Support:

• Linear Recurrent Unit (LRU)
• Gated Impulse Linear Recurrent (GILR) layer

TODO:

• S5
• Simple Recurrent Unit (SRU)

Requirement

Install triton https://github.com/openai/triton