How the pretrained model trained?

[alqurri77]

I wonder if the pre-trained model "swin_tiny_patch4_window7_224.pth" is trained on only the encoder part of the model or the whole model.
My point is, suppose we did any modification to Swin-Unet, how do we do pretraining on imageNet.