long-range-arena

There are 8 repositories under long-range-arena topic.

  • lucidrains/Mega-pytorch

    Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena

    Language:Python2038210

  • FutureComputing4AI/Hrrformer

    Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)

    Language:Python49315

  • OSU-STARLAB/LeaPformer

    [ICML 2024] Official implementation of "LeaPformer: Enabling Linear Transformers for Autoregressive and Simultaneous Tasks via Learned Proportions."

    Language:Python9101

  • FutureComputing4AI/HGConv

    HGConv: Holographic Global Convolutional Networks

    Language:Python6101

  • lucaslingle/e-lra

    Streamlined variant of Long-Range Arena with pinned dependencies, automated data downloads, and deterministic shuffling.

    Language:Python3200

  • hazdzz/FNet

    The PyTorch implementation of FNet.

    Language:Python0200

  • hazdzz/Linformer

    The PyTorch implementation of Linformer.

    Language:Python0200

  • hazdzz/Paramixer

    The PyTorch implementation of Paramixer.

    Language:Python0100