microsoft/VideoX

Request for test files for k600 zeroshot evaluation

muzairkhattak opened this issue · 2 comments

Hi,

I hope you will be doing great!

It is kindly requested to please share the 3 test.txt files for K600 zero-shot testing whose results are reported in the main paper.
I am also confused if the test protocol was in generalized zero-shot manner or non-generalized? As it is mentioned that 160 categories were used for evaluation. Does the text classifier also had only corresponding 160 category embedding or all 600 classes?

It would be very helpful if you can provide all the required files that can allow us to reproduce exactly same numbers for ZS K600 as reported in your main paper.

Thank you. Waiting for your kind response as it is a bit urgent due to CVPR deadline.

nbl97 commented

I didn't immediately notice this issue and feel sorry for the late reply.

The three files you mentioned are uploaded here.

Hope everything goes well with your work.

No problem @nbl97,

I was able to generate those files.

Thank you very much.