Re-basin via implicit Sinkhorn differentiation
Implementation of paper Re-basin via implicit Sinkhorn differentiation (Accepted at CVPR 2023).
pip install sinkhorn-rebasin
|
|
Basics |
|
Models alignment |
|
Linear mode connectivity |
|
cd examples
python main_alignment_{mlp|cnn|resnet}.py
Example |
Layer from $\theta_A$
|
Layer from $\pi_{\mathcal{P}}(\theta_A)$
|
Layer from $\theta_B$
|
MLP |
|
|
|
VGG |
|
|
|
ResNet18 |
|
|
|
cd examples
python main_lmc_{mlp|cnn|resnet}.py
Dataset |
Model |
Accuracy LMC |
Cross Entropy Loss LMC |
Mnist |
MLP |
|
|
Mnist |
VGG |
|
|
Imagenette-320 |
ResNet18 |
|
|