/GraphSelfAttention

Primary LanguagePythonMIT LicenseMIT

GraphSelfAttention

An experimental architecture utilizing location-based attention with adjacency matrices and LoRA and DoRA Linear Layers.

(Work in Progress.)