/VICRegANNpt

Variance-Invariance-Covariance Regularization artificial neural network (VICRegANN) for PyTorch - local/greedy training - experimental

Primary LanguagePythonMIT LicenseMIT

VICRegANNpt

Author

Richard Bruce Baxter - Copyright (c) 2023 Baxter AI (baxterai.com)

Description

Variance-Invariance-Covariance Regularization artificial neural network (VICRegANN) for PyTorch - experimental

An implementation of; Bardes, A., Ponce, J., & LeCun, Y. (2021). Vicreg: Variance-invariance-covariance regularization for self-supervised learning. arXiv preprint arXiv:2105.04906. https://arxiv.org/abs/2105.04906

License

MIT License

Installation

conda create -n pytorchsenv
source activate pytorchsenv
conda install python
pip install datasets
pip install torch
pip install lovely-tensors
pip install torchmetrics

Execution

source activate pytorchsenv
python ANNpt_main.py