/simplicial-attention

Explorations into the paper Simplicial Hopfield Networks, to see if any of the learning points can improve upon attention in a transformers setting

MIT LicenseMIT

Simplicial Attention (wip)

Explorations into the paper Simplicial Hopfield Networks, to see if any of the learning points can improve upon attention in a real-world transformers setting

Citations

@inproceedings{burns2023simplicial,
    title   = {Simplicial Hopfield networks},
    author  = {Thomas F Burns and Tomoki Fukai},
    booktitle = {The Eleventh International Conference on Learning Representations },
    year    = {2023},
    url     = {https://openreview.net/forum?id=_QLsH8gatwx}
}