Comparision with VisionLSTM-Out
bio-mlhui opened this issue · 1 comments
bio-mlhui commented
Mamba and xLSTM are both RNN models, what is the Imagenet1k-acc if the Lstm transform are removed?
BenediktAlkin commented
The surrounding components of the Mamba SSM and the mLSTM cells are really similar (up projection -> SSM/mLSTM -> gated MLP -> downprojection -> skip connection) so VisionLSTM-Out would be more or less equivalent to Mamba-Out.