Problems during training

[licaizi]

Thanks for your excellent work, I'm curious about the settings in the script "train_clips32k.sh", how am I supposed to set them if I wanna reach comparable performance reported in the paper, such as "arch", "batch_size_per_gpu", "opts".

One more thing, the lr is weird since it is too small during training, what should i do to make it normal? thanks a lot for your work again!

[Kyfafyd]

Hi, @licaizi thanks foy your interest!
We use vit-b/16 architecture, wth batch_size 4 (for 24G GPU). You may not need to modify anything here but only run train_clips32k.sh.
The learning rate is using warmup in the begining, so it is small.

[licaizi]

@Kyfafyd got it, very grateful for your reply!