facebookresearch/AVT

Generate submitted file

Opened this issue · 3 comments

interestingzhuo commented

We can only see the accuracy of validation set, when we run
python launch.py -c expts/02_ek100_avt_tsn.txt -l -t.

Can you tell us how to generate the submitted file for the challenge ek100?

interestingzhuo commented

Please see instructions here: https://github.com/facebookresearch/AVT/blob/main/docs/MODELS.md#epic-kitchens-100-testchallenge-submission

It seems that the script is used to fuse the results of different model. How can I generate the submitted file using only one model, such as "02_ek100_avt_tsn_test_testonly.txt"? ''python launch.py -c expts/02_ek100_avt_tsn.txt -l -t'' can only evaluate the model in the validation set?

rohitgirdhar commented

Hi, apologies for the delay. You can always pass in a single file with weights = 1 and it will generate outputs for that single file.
Also since the test set is not public, the code itself can only do evaluation on the val set. For test results you need to submit to the evaluation server.