/MC-SGD

Linear Mode Connectivity in Multitask and Continual Learning: https://arxiv.org/abs/2010.04495

MIT LicenseMIT

Linear Mode Connectivity in Multitask and Continual Learning

Notice

The code and a complementary blog post will be added soon! For now, you can use the CodaLab links below which includes an earlier version of the code.

Reproducing the Results

Here are the links for reproducing the Rotated MNIST experiment with 20 tasks:
Trial 1: https://worksheets.codalab.org/bundles/0x0bc0c840d8c94df3ab86fcbcc6c708a2
Trial 2: https://worksheets.codalab.org/bundles/0xe8ddd60c4e444ba8a3d90d7e6a618ea6
Trial 3: https://worksheets.codalab.org/bundles/0x4559421edbfd4a938857ae92451d367a
Trial 4: https://worksheets.codalab.org/bundles/0x844fc807b9714c748fca3a79c0f523e9
Trial 5: https://worksheets.codalab.org/bundles/0x3757e841dccf46759f7aa0b445ca720a