mhamilton723/STEGO

I cannot reproduce vit-small@cocostuff27 using the default config

rayleizhu opened this issue · 1 comments

Hi, thanks for open-sourcing this elegant codebase.

As a starting point, I try to reproduce the results in your paper. However, using vit-small@cocostuff27, I can only achieve 18.13/30.59 mIoU (no CRF) using cluster/linear probe respectively, while the reported results in the paper are 24.0/38.4 mIoU (no CRF). I do not change anything in the code, and only change the 6 hyperparameters to the numbers reported in the paper.

How can I reproduce the performance mentioned in the paper?

If you load our pretrained model you should able to reproduce those numbers. The pre-trained model also has the specific values of the hyperparameters used so that you can verify. Also the CRF adds a few points of perf in there too