smj0/IS-BERT

An Unsupervised Sentence Embedding Method by Mutual Information Maximization (EMNLP2020)

Install first

pip3 install -e .

Training

python3 examples/training/nli/unsupervised_training_nli.py

Acknowledgements

Codes are adapted from the repos of the EMNLP19 paper Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks and the ICLR19 paper Learning Deep Representations by Mutual Information Estimation and Maximization