RElbers/info-nce-pytorch

Contribute to PyTorch?

adamjstewart opened this issue · 2 comments

Have you ever considered contributing this loss function to PyTorch? TorchGeo would love to use it for SimCLR/MoCo SSL but we are trying to avoid adding yet another dependency. If it was built into PyTorch, it would be much easier to use.

I understand the desire to limit the number of dependencies. I'll see what I can do.

We ended up using the lightly implementation because we needed it anyway for other SSL features. I'll close this since I personally no longer have a need for this, but I still think it would be cool if this loss was in PyTorch someday.