/Contrastive_Learning_Papers

A list of contrastive Learning papers

Contrastive_Learning_Papers

A list of papers in contrastive learning.

Computer Vision

Year Title Venue Code
2021 SEED: Self-supervised Distillation For Visual Representation ICLR Code
2021 PROTOTYPICAL CONTRASTIVE LEARNING OF UNSUPERVISED REPRESENTATIONS ICLR Code
2021 Training GANs with Stronger Augmentations via Contrastive Discriminator ICLR Code
2021 Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learning ICLR Code
2021 Active Contrastive Learning of Audio-Visual Video Representations ICLR Code
2021 Conditional Negative Sampling for Contrastive Learning of Visual Representations ICLR Code
2021 Learning a Few-shot Embedding Model with Contrastive Learning AAAI Code
2021 Contrastive Learning with Stronger Augmentations IEEE Code
2021 Dual Contrastive Learning for Unsupervised Image-to-Image Translation NTIRE Code
2021 With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations DeepMind code
2021 How Well Do Self-Supervised Models Transfer? CVPR Code
2021 Self-supervised Pretraining of Visual Features in the Wild arxiv Code
2021 VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples CVPR Code
2021 Temporal Contrastive Graph Learning for Video Action Recognition and Retrieval arxiv code
2021 Social NCE: Contrastive Learning of Socially-aware Motion Representations arxiv Code
2021 Spatiotemporal Contrastive Video Representation Learning CVPR Code
2021 What Should Not Be Contrastive in Contrastive Learning ICLR code
2020 A Simple Framework for Contrastive Learning of Visual Representations ICML Code
2020 Online Bag-of-Visual-Words Generation for Unsupervised Representation Learning arxiv Code
2020 CASTing Your Model:Learning to Localize Improves Self-Supervised Representations arxiv code
2020 Exploring Simple Siamese Representation Learning arxiv code
2020 Hard Negative Mixing for Contrastive Learning NeurIPS code
2020 Representation Learning via Invariant Causal Mechanisms arxiv code
2020 Are all negatives created equal in contrastive instance discrimination? arxiv code
2020 Bootstrap your own latent: A new approach to self-supervised Learning arxiv Code
2020 Augmented Skeleton Based Contrastive Action Learning with Momentum LSTM for Unsupervised Action Recognition Information Sciences Code
2020 Deep Robust Clustering by Contrastive Learning arxiv code
2020 Contrastive Learning for Unpaired Image-to-Image Translation ECCV Code
2020 Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases arxiv code
2020 Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework ACMMM Code
2020 Unsupervised Learning of Visual Features by Contrasting Cluster Assignments NeurIPS Code
2020 Contrastive Learning with Adversarial Examples NeurIPS code
2020 ContraGAN: Contrastive Learning for Conditional Image Generation NeurIPS Code
2020 Prototypical Contrastive Learning of Unsupervised Representations arxiv Code
2020 CLOCS: Contrastive Learning of Cardiac Signals arxiv code
2020 On Mutual Information in Contrastive Learning for Visual Representations arxiv code
2020 What makes for good views for contrastive learning ECCV Code
2020 CURL: Contrastive Unsupervised Representations for Reinforcement Learning arxiv Code
2020 Supervised Contrastive Learning arxiv Code
2020 Clustering based Contrastive Learning for Improving Face Representations IEEE code
2020 Improved Baselines with Momentum Contrastive Learning arxiv Code
2020 Self-labelling via simultaneous clustering and representation learning ICLR Code
2020 Momentum Contrast for Unsupervised Visual Representation Learning CVPR Code
2020 Self-Supervised Learning of Pretext-Invariant Representations CVPR/IEEE code
2020 Data-Efficient Image Recognition with Contrastive Predictive Coding arxiv Code
2020 Contrastive Multiview Coding arxiv Code
2019 Transferable Contrastive Network for Generalized Zero-Shot Learning ICCV Code
2019 Selfie: Self-supervised Pretraining for Image Embedding arxiv Code
2019 Local Aggregation for Unsupervised Learning of Visual Embeddings arxiv Code
2019 Learning Representations by Maximizing Mutual Information Across Views arxiv Code
2019 Unsupervised Embedding Learning via Invariant and Spreading Instance Feature CVPR Code
2019 Invariant Information Clustering for Unsupervised Image Classification and Segmentation ICCV Code
2019 Learning deep representations by mutual information estimation and maximization ICLR Code
2019 Representation Learning with Contrastive Predictive Coding arxiv Code
2018 Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination CVPR Code
2018 Time-Contrastive Networks: Self-Supervised Learning from Video arxiv Code
2017 Multi-task Self-Supervised Visual Learning ICCV code
2016 Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles ECCV Code
2015 Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks arxiv Code
2010 Noise-contrastive estimation: A new estimation principle for unnormalized statistical models AISTATS code

Natural Language Processing

Year Title Venue Code
2021 Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning ICLR Code
2021 What Should Not Be Contrastive in Contrastive Learning ICLR Code
2021 Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval ICLR Code
2021 Contrastive Learning with Adversarial Perturbations for Conditional Text Generation ICLR Code
2021 Prototypical Contrastive Learning of Unsupervised Representations ICLR Code
2021 Contrastive Learning with Hard Negative Samples ICLR Code
2021 FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders ICLR Code
2021 Self-Supervised Contrastive Learning for Efficient User Satisfaction Prediction in Conversational Agents NAACL Code
2021 SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency NAACL Code
2021 Supporting Clustering with Contrastive Learning NAACL Code
2021 Understanding Hard Negatives in Noise Contrastive Estimation NAACL Code
2021 Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis NAACL Code
2021 Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach NAACL Code
2021 COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining arxiv Code
2021 SimCSE: Simple Contrastive Learning of Sentence Embeddings arxiv Code
2021 A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection AAAI Code
2020 ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators ICLR Code
2020 DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations arxiv Code
2020 Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models ACL Code
2020 CLEAR: Contrastive Learning for Sentence Representation arxiv code
2020 CERT: Contrastive Self-supervised Learning for Language Understanding arxiv code
2019 A Theoretical Analysis of Contrastive Unsupervised Representation Learning arxiv code
2019 Representation Learning with Contrastive Predictive Coding arxiv Code

Graph

Year Title Venue Code
2021 An Empirical Study of Graph Contrastive Learning Openreview code
2021 Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning KDD code
2021 Enhanced Graph Learning for Collaborative Filtering via Mutual Information Maximization SIGIR code
2021 Self-supervised Graph Learning for Recommendation SIGIR code
2021 Graph Contrastive Learning with Adaptive Augmentation TheWeb code
2020 Contrastive Self-supervised Learning for Graph Classification arxiv code
2020 Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learning ICDM code
2020 GraphCL: Contrastive Self-Supervised Learning of Graph Representations Neurips code
2020 Deep Graph Contrastive Representation Learning arxiv Code
2020 Graph Contrastive Learning with Augmentations NeurIPS Code
2020 Gcc: Graph contrastive coding for graph neural network pre-training KDD Code
2019 Deep Graph Infomax ICLR Code

Recommender System

Year Title Venue Code
2021 Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems SIGIR Code
2021 Self-supervised Graph Learning for Recommendation SIGIR Code
2021 Contrastive Pre-training for Sequential Recommendation arxiv Code
2021 Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation WWW Code
2020 Self-supervised Learning for Large-scale Item Recommendations arxiv code

Survey

Year Title Venue Code
2021 Self-supervised Learning: Generative or Contrastive arxiv code
2021 Self-Supervised Learning of Graph Neural Networks: A Unified Review arxiv code

Others

Year Title Venue Code
2021 Towards Effective Context for Meta-Reinforcement Learning: an Approach based on Contrastive Learning AAAI code

Future Plan

Welcome to join us to expand this repo. In the future, we hope to make this list into finer categorizations. We know that in the computer vision and natural language processing area, there are already a lot of sub-areas are researching the contrastive learning. Therefore, it is important to create some sub-category to include those papers. Feel free to contact us if you are interested: jim96liu@gmail.com