ServiceNow/embedding-propagation

Training

cvprkang opened this issue · 1 comments

I findthat the pre-training and fine-tuning time for this work is very long. Is there any way to speed up the training time?

You could try to use automatic mixed precision (amp) https://pytorch.org/blog/pytorch-1.6-released/