lightly-ai/lightly

Self-Supervised Methods Tracker

guarin opened this issue · 3 comments

guarin commented

The goal of this issue is to track new self-supervised methods and to which extent they are implemented in Lightly.

See also our #papers channel on discord for the newest papers!

Contributing

There are many ways on how you could contribute to either this list or the implementations :)

  • Tell us about new methods in a comment
  • Gather information about a new method and how we could implement it and write an issue for it
  • Make a PR for a new model or parts of it
  • Test already implemented methods

Methods

CrossMAE [25. Jan. 2024] Paper Code

  • Status: Not Implemented

l-DAE [25. Jan. 2024] Paper

  • Statue: Not Implemented

LDReg [19. Jan. 2024] Paper Code

  • Status: Not implemented

AIM [16. Jan. 2024] Paper Code

  • Status: 🚧 In progress
    • Missing
      •  Examples & Docs
      • Benchmark
  • PR: #1479

SSL-EY [8. Dec. 2023] Code

  • Status: 🚧 In progress
  • PR: #1443

MMCR [3. Dec. 2023] Paper

  • Status: 🚧 In progress
  • Issue: #1423

CycleCL [5. Nov. 2023] Paper

  • Status: Not Implemented
  • Issue: #1447

V-JEPA [21. Sept. 2023] Paper

  • Status: Not implemented

FlexPredict [31. Jul. 2023] Paper

  • Status: Not implemented

EMP-SSL [08. Apr. 2023] Paper Code

  • Status: 🚧 In progress
  • Issue #1343

MAE-CT [20. Apr. 2023] Paper Code

  • Status: Not implemented

DinoV2 [14. Apr. 2023] Paper Code

  • Status: 🚧 In progress
  • Issue: #1166

Siamese DETR [31. Mar. 2023] Paper Code

  • Status: Not implemented

MixedMAE [30. Mar. 2023] Paper

  • Status: Not implemented

D3SSL [29. Mar. 2023] Paper

  • Status: Not implemented

Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Data [23. Mar. 2023] Paper

  • Status: 🚧 In progress
  • Issue: #1319

All4One [16. Mar. 2023] Paper

  • Status: Not implemented

LOCA [15. Mar. 2023] Paper

  • Status: Not Implemented

I-JEPA [19. Jan. 2023] Paper Code

  • Status: 🧪 Experimental #1273

SparK [9. Jan. 2023] Paper Code

  • Status: Not Implemented
  • Issue: #1462

CAN [20. Oct. 2022] Paper

  • Status: Not implemented

PMSN [13. Oct. 2022] Paper

  • Status: ✅ Done

FastSiam [22. Sept. 2022] Paper

  • Status: ✅ Done

MixMAE [25. May. 2022] Paper

  • Status: Not implemented

A2MIM [22. May. 2022] Paper

  • Status: Not implemented
  • Issue: #1315

SimMIM [18. Nov. 2021] Paper

  • Status: ✅ Done
  • Missing:

DirectCLR [18. Oct. 2021] Paper Code

  • Status: 🚧 In progress #781

MoCoV3 [5. Apr. 2021] Paper Code

SEER [2. Mar. 2021]Paper Code

  • Status: Not implemented

W-MSE [13. Jul. 2020] Paper Code

  • Status: ✅ Done #1424
  • Missing:
    • Projection head
    • Docs
    • Benchmarks
Natyren commented

Hello! If I would like to add method to lib, best way - create issue and start working on it? For example I'm ready to start implementation of MAE-CT (or MAE, looks like it isn't here).

guarin commented

Hi @Natyren! Thanks a lot for your interest. Yes please create a new issue for it. MAE is already implemented, see https://docs.lightly.ai/self-supervised-learning/examples/mae.html for examples.

guarin commented

Added FlexPredict: Predicting masked tokens in stochastic locations improves masked image modeling: https://arxiv.org/abs/2308.00566