VITA-Group/Q-GaLore
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
PythonApache-2.0
Issues
- 0
Finetuning Code Samples
#7 opened by lucasmgomez - 0
- 0
- 0
- 1
Distributed Training?
#1 opened by philschmid
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
PythonApache-2.0