implementation of linformer (https://arxiv.org/abs/2006.04768) in tensorflow.js for text generation with
- causal training
- linear attention
implementation of linformer (https://arxiv.org/abs/2006.04768) in tensorflow.js for text generation with
- causal training
- linear attention