Question about training with fewer GPUs
Scalsol opened this issue · 2 comments
Scalsol commented
Thanks for sharing your great work! I have several questions:
- It seems like that you implement your training on 16 GPUs. I want to ask whether training on 4 GPUs will degrade the performance? Have you carried experiments on 4 GPUs?
- You mentioned in your paper that SyncBN is used but it seems like this is missed in your config files? But the performance reported in this repo seems similar with the results in your paper.
BTW, I suggest you to merge all your TSD configs into a single directory :)
songguanglu commented
HI,thanks for your advice and I will merge the TSD configs into a single directory in the next update.
- Fewer GPUs will not degrade the performance and you should modify the training parameters according to the Tips in the readme.
- TSD is firstly implemented in our own framework with SyncBN and in mmdet, we reimplement it with the BN both in baseline and TSD (In order to be consistent with the other algorithms in mmdet). We find the influence of BN is not obvious.
Scalsol commented
I see. Thanks for your reply :)