/g-mlp-tensorflow

A gMLP (gated MLP) implementation in Tensorflow 1.x, as described in the paper "Pay Attention to MLPs" (2105.08050).

Primary LanguagePython