how to finetune 384x384 model

Question

how to finetune 384x384 model

youngwanLEE opened this issue 3 years ago · 4 comments

youngwanLEE commented 3 years ago

Hi,

Could you share the script for finetuning 384x384 model?

Answer 1 · 2021-10-08T17:38:42.000Z

Sure, I will release the related script this weekend.

Answer 2 · 2021-10-09T12:28:06.000Z

@xwjabc Thanks for the quick response !!

I have utilized your CoaT and Factorized Attention module, and I think it is very effective !! 👍

Also, I'm very impressed by your effort to maintain this code. :)

Answer 3 · 2021-12-08T05:03:22.000Z

Hi @youngwanLEE, I am sorry for the severe delay due to some of my personal affairs! I have recently added the fine-tuning script for 384x384 model. Feel free to try it out.

In addition, since I am not available to access enough GPUs these days, I have not tried to reproduce the results (84.5%) using the updated fine-tuning script with the latest code in the repo. If you find that the results are not reproducible, please do not hesitate to point it out. I will try my best to help with any issues and hopefully get some computation resources to reproduce the results.

Answer 4 · 2021-12-08T05:13:04.000Z

@xwjabc Thank your for the kind reply :)