maple-research-lab/CLSA

Questions about module universality

pikeyang opened this issue · 2 comments

pikeyang commented

Has it been tested on models such as SimCLR and BYOL? Can you provide some hints

wang3702 commented

We have tested on BYOL. The idea is very simple, please just include our stronger augmentation as another branch and calculate the divergence loss. The network for this branch is just the query network.

pikeyang commented

Thanks!