Potential mistake in SegFormer model: `patch_size` argument in SegFormer model not being used.
jonasdieker opened this issue · 1 comments
Hi there,
first of all thank you for your work and providing all the code! I was looking at the following lines in the SegFormer backbone model:
SegFormer/mmseg/models/backbones/mix_transformer.py
Lines 203 to 220 in 65fa8cf
I noticed that the argument patch_size
is not actually being used for the OverlapPatchEmbed
modules.
Instead you hard coded a patch sizes of [7, 3, 3, 3] for the 4 blocks. While this of course is still smaller than the 16x16 patches in ViT, and thus still lends itself better to detection and segmentation tasks, the model deviates from the paper, where you describe an initial patch size of 4 being used. This also means that classes inheriting from this class do not use the argument at all!
Maybe I am misunderstanding something, so I would be happy if you could shed some light on this potential mistake! Thank you.
Hi Jonas, I've also observed something similar and this needs to be clarified either in the paper or in the code above!