Introduction: Introduction to contrastive learning.
paper: https://arxiv.org/pdf/2012.06985v2.pdf
Contrastive learning of global and local features for medical image segmentation with limited annotations
Introduction: Use contrastive learning to perform unsupervised pretraining on networks with encoder-decoder structure.
paper: https://papers.nips.cc/paper/2020/file/949686ecef4ee20a62d16b4a2d7ccca3-Paper.pdf
code: https://github.com/krishnabits001/domain_specific_cl
Introduction: If you happen to use two sets of parameters when you do contrastive pretraining. Can also be used when we only have a small proportion of data labeled.
paper: https://arxiv.org/pdf/2106.01226.pdf
Introduction: A way to make model more generalized for different scenarios. But I think this can already be achieved by self-supervised learning with data augmentation? Not sure whether this methid will work better.