/flora-opt

This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.

Primary LanguagePythonGNU Lesser General Public License v3.0LGPL-3.0

Watchers