linear-transformer

There are 5 repositories under linear-transformer topic.

  • ridgerchu/matmulfreellm

    Implementation for MatMul-free LM.

    Language:Python2.9k4435187

  • fudan-zvg/SOFT

    [NeurIPS 2021 Spotlight] & [IJCV 2024] SOFT: Softmax-free Transformer with Linear Complexity

    Language:Python30881225

  • cornell-zhang/Polynormer

    Polynormer: Polynomial-Expressive Graph Transformer in Linear Time

    Language:Python37921

  • mjhydri/Singing-Vocal-Beat-Tracking

    This repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trains linear multi-head self-attention layers on top of them to extract vocal beat activations. Then, it uses HMM decoder to infer signing beats and tempo.

    Language:Python27214

  • mzguntalan/red

    A place for code to relax in happiness without the pressure of maintenance. Mostly related to Machine Learning and Deep Learning

    Language:Python0100