ZhaoJ9014/face.evoLVe

Slow training

Opened this issue · 1 comments

I am training IR-152 on MsCeleb1M. The gpu i am training on is NVIDIA RTX A4000. It takes about 11 hours per epoch. And if i want to train the model for 125 epoch it will take about 60 days. Is it normal?

I have same problem. Is that slow like you mention (the gpu I use NVIDIA RTX 3090Ti)