cheerss/CrossFormer

question about LDA and SDA for irregular feature map

Huzhen757 opened this issue · 0 comments

Thank you very much for your careful reply about LDA and SDA ,but I have another question about LDA and SDA for irregular
feature map。

In your paper,the LDA and SDA used for regular input image size,like 224x224 or 384x384. So the group size is default 7,
and the I is set (8, 4, 2, 1) . And for Stage-1, the I = 8, because of the need to meet GxI = feature map width/height(56x56).

However, for irregular feature map size, for example, 80 x 134, now for the group size and interval ,It seems that we can no longer design as mentioned in the paper。If the group size is 7,it's need to padding feature map to apply the group size,then the feature map size is become 84x140, the feature map reshape to [W_nG, G, H_nG, G], SDA here can be executed normally。 but for next LDA,how to set the interval I ?Besides,the feature map is irregular,so the interval I is different for width and height。How can I reasonably set the parameter interval I ?

Can you give me some advice about this question?Thanks!