Sense-X/UniFormer

Training time for kinetics-400

AbdelrahmanShakerYousef opened this issue · 6 comments

AbdelrahmanShakerYousef commented

Hello,

Thank you for sharing the codebase of your exciting work.

Could you please let me know the training time for pertaining & training on kinetics-400 and the resources you used?

Thank you!

Andy1621 commented

Thanks for your question.
In my original experiments, all the models are run on a single V100 machine (8GPU) except the largest model.
For detailed training time, you can find the provided logs! It may take ~2 days to train K400 for 110 epochs with 16 frames.

For your experiments, you can use fewer epochs (~55) and fewer frames (~8) to verify your idea fastly.

AbdelrahmanShakerYousef commented
Andy1621 commented

It's a good question.
As a new backbone, it needs to be pre-trained on ImageNet first, which will cost 12 day. Thus, it actually needs about 34 days to verify it on K400.
However, the performance trend is similar. Those models work better on ImageNet often work better on K400.

AbdelrahmanShakerYousef commented

Thank you Andy for your reply. Is it 12 days or 34 days? I guess your text is unclear about that.

Andy1621 commented

1 to 2 days and 3 to 4 days.

The ~ automatically changes to delete.😊

Andy1621 commented

Hi! We have released UniFormerV2, which adopts pretrained ViT. It can save a lot of training resources. Welcome to try it!