The code repository for the main experiments in the paper Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication and Decentralized Deep Learning with Arbitrary Communication Compression.
Please refer to the folders convex_code and dl_code for more details.
If you use the code, please cite the following papers:
@inproceedings{ksj2019choco,
author = {Anastasia Koloskova and Sebastian U. Stich and Martin Jaggi},
title = {Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication},
booktitle = {ICML 2019 - Proceedings of the 36th International Conference on Machine Learning},
url = {http://proceedings.mlr.press/v97/koloskova19a.html},
series = {Proceedings of Machine Learning Research},
publisher = {PMLR},
volume = {97},
pages = {3479--3487},
year = {2019}
}
and
@inproceedings{koloskova*2020decentralized,
title={Decentralized Deep Learning with Arbitrary Communication Compression},
author={Anastasia Koloskova* and Tao Lin* and Sebastian U Stich and Martin Jaggi},
booktitle={International Conference on Learning Representations},
year={2020},
url={https://openreview.net/forum?id=SkgGCkrKvH}
}