How to improve the speed when loading shapenet data?

[Be997398715]

As image above, I test the loading time of read_pcd file , each file needs about 3~4s , is there any way to improve training process ?
Wish for your reply!

[hzxie]

The data is loaded in an asynchronous way. As you can see, the data time is 0, which means the bottleneck of the training process is not data loading.

[Be997398715]

actactually it is asynchronous，but each minibatch data need to load(here batchsize=32). And I found the minibatch data havent been ready for next training, which means each minibatch train needs at least 8 data, and each data file needs about 3s to read from IO function. I think this is the key peroblem. I hope for your reply.

[hzxie]

Please try to use more data loader workers.