eai-lab/SoftmaxOutputApproximation
[NeurIPS 2023] Softmax Output Approximation for Activation Memory-Efficient Training of Attention-based Networks
Python
[NeurIPS 2023] Softmax Output Approximation for Activation Memory-Efficient Training of Attention-based Networks
Python