training time about the xmem

[Qi-Zhangyang]

Hello, I want to ask the training time of the XMem. especially XMem-s03.pth and XMem-s3.pth.
I just training the datasets on the DAVIS & Youtube datasets (setting:3). The config is:
batchsize 4, GPUs: 4 iterations: 200000, finetune: 20000. It is about 1.5 -2 days.

I have printed the training time of all parts:

Time taken for encode_key: 0.006
Time taken for encode_value: 0.029
Time taken for forward_others: 0.190
Time taken for loss_backward: 0.566

I want to ask why the loss_backward is so slow.

Thanks

[hkchengrex]

I haven't assessed the running time for individual components so I am not sure.

[Qi-Zhangyang]

Thanks, I wanna know the total training time of your config and project.

[hkchengrex]

Cannot recall now but the logs are here: #71