NVlabs/FasterViT

How to determine the args.mesa ratio?

Kim-DKyu opened this issue · 0 comments

First, thank you for sharing your wonderful work as an open source. I appreciate your work.
I found in the TRAINING.md you provided that the args.mesa parameter settings differ for each model as follows:
FasterViT-0 : args.mesa 0.1
FasterViT-1 : args.mesa 0.2
FasterViT-2/3 : args.mesa 0.5
FasterViT-4/5/6 : args.mesa 5.0

I am curious about the criteria used to determine the mesa parameter for each model and whether the mesa-start-ratio is uniformly applied at 25% for all models.
Your response would be greatly appreciated. Thank you.