dataloader is lagging strangly when num_workers>0

[smallbox120]

I ran the code with dataloader num_workers=4, the training process seems to be lagging due to the dataloader because num_workers=4 causes the GPU to progress 4 batches at a time, with massive waiting time in between. What could possiblly be the reason behind this strange phenomenon? Many Thanks for any hint that might help!