The zero-shot classification acc is lower than origin paper

Question

The zero-shot classification acc is lower than origin paper

Closed this issue 2 years ago · 2 comments

Thanks for your wonderful work which is helpful for my research. I found that when I use 'bash zeroshot.sh', the classification acc is about 19.33% (20.18% in your paper). I have tried many times. But the gap still exists. Please help me, thank you again !

Answer 1 · 2022-04-27T15:50:13.000Z

Thanks for your interests! you can use --post-search in the 'bash zeroshot.sh' searching for the best view weights. It will give 20%+ performance. You can also change "SEARCH/TIME: 4" in the config, e.g. 10 or larger, which leads to finer search and higher accuracy.

Answer 2 · 2024-03-20T01:31:08.000Z

Thanks for your advice. I have achieved a higher accuracy.