Deformable DETR code

Question

Deformable DETR code

yuzitian opened this issue 2 years ago · 5 comments

Hi, thank you for a good job. You did experiments with DETR-like models in your paper. I would like to ask if it is convenient for you to open the source code of the experiment with Deformable DETR?

Answer 1 · 2023-02-19T15:37:23.000Z

Hi,

Yes we plan to release sqr-deformable detr in a couple of weeks as the team is on leave

Answer 2 · 2023-03-10T04:51:55.000Z

[update] Released. Please refer to the readme.md

Recommend following the original deformable detr setting (32 as batchsize 8*A100 x 4 imgs per GPU ), but it seems 16 as batchsize performs similarly. Expecting 45.8±0.2 AP. Thanks

Answer 3 · 2023-07-02T06:58:11.000Z

Thank you very much for your reply. I ran your code as soon as you replied. Due to insufficient memory on my device, I am unable to use the same configuration as you. But I got a bad result. After carefully reviewing the code, I found that you did not update the reference points during the decoder process. May I ask why you are handling this in this place?

Answer 4 · 2023-07-10T05:25:44.000Z

Hi,

I am not sure what hyperparameter you changed in config, but some of them are critical, such as query number, feature dimension, encoder layer number, decoder layer number, etc.

For sqr-deformable-detr, we do not collect the reference points, because if the reg_branch is None (one stage), the reference points are not updated, so for SQR, it is also unnecessary to do that.

If you do not have enough memory to run your research, I recommend using sqr-adamixer which runs well with 8x24GB card.

Answer 5 · 2023-07-11T01:48:44.000Z

Thank you a lot for your advice. Wish you have a nice day !!