facebookresearch/vicreg

Coefficients of loss

ChicyChen opened this issue · 0 comments

ChicyChen commented
  • Hi, in the code the std loss is averaged by 2 (not the same as the paper) while the cov loss is not (same as the paper). Then, is the coefficient of mse vs. std vs. cov loss still 25.0 & 25.0 & 1.0 (same as the paper), but not 25.0 & 50.0 & 1?

    vicreg/main_vicreg.py

    Line 211 in 4e12602

    cov_loss = off_diagonal(cov_x).pow_(2).sum().div(

    Thanks a lot!