Training on multi-GPU

[Xuehao-Gao]

Hi dear author,
I would like to train the temos on multi-GPU. As shown in Fig.1, It runs well when using one GPU as default. But, when I try to run it on multi-GPU and set the gpus: 4 in the trainer config file, I meet a Type Error shown in Fig.2. So, I would like to know how to train temos on multi-GPU well.

One GPU Training:

Four GPUs Training:

[Mathux]

Hello @Lucky-Maximize,

I just solved this "pickle problem" with this commit: 3e0efdd

Actually, the current code is not designed for GPU-training and it is not working yet. When I will have more time, I will probably investigate and make it work. I need to redesign a bit the data loading, and the metric computation.