One GPU is working during Evaluation
Opened this issue · 1 comments
khawar-islam commented
Hi @zhongyy
I have noted that while training all GPUs are working but when performance evaluation is started only 1 GPU is used. Would it be possible to use four GPUs during performance evaluation? It will make the process faster.
Regards,
Khawar
zhongyy commented
Hi Khawar, Sorry for the late reply. Thanks for your interests, and good advices. While it is not easy for me to implement your good ideas. Transformers realy consumes a lot and I am busy with another project these days. So I am afraid that I cannot update it.