/dual-attention

Python package implementing the Dual Attention Transformer (DAT), as proposed by the paper "Disentangling and Integrating Relational and Sensory Information in Transformer Architectures" by Awni Altabaa, John Lafferty.

Primary LanguagePythonMIT LicenseMIT

Watchers