retnet
There are 5 repositories under retnet topic.
JosefAlbers/Phi-3-Vision-MLX
Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
ednial0zavlare/MixKABRN
This is the repo for the MixKABRN Neural Network (Mixture of Kolmogorov-Arnold Bit Retentive Networks), and an attempt at first adapting it for training on text, and later adjust it for other modalities.
smallscientist1/attention_autotuner
an autotuner for the flash version of attention and retnet
Faptimus420/RetNet-keras-core
An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"