attentio

There are 2 repositories under attentio topic.

  • kyegomez/MGQA

    The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints"

    Language:Python12201

  • alessioborgi/AdaViT

    Adaptive Vision Transformer for efficient image classification, implementing dynamic token sparsification to reduce computational costs while maintaining accuracy.

    Language:Python1200