fawazsammani/awesome-mlp-mixer

FNet: Mixing Tokens with Fourier Transforms

Closed this issue · 1 comments

etienne87 commented

FNet: Mixing Tokens with Fourier Transforms https://arxiv.org/abs/2105.03824
Does FNet belong? After all, DCT can be implemented (and is on TPUs) in one matrix-multiplication accross patch-dimension.

fawazsammani commented

Thanks for letting me know. It seems that this paper came around the same time as MLP mixer....It is very relevant.
I've added it to the list

  • 👍1