/distributed-lion-pytorch

Distributed Lion optimizer that works on extremely low bandwidth and robust against worker drop-out

Primary LanguagePython

Stargazers