This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
Primary LanguagePythonGNU Lesser General Public License v3.0LGPL-3.0