Patch Embedding Module gradient update

[Abdurrahheem]

MUSIQ/trainer.py

Line 47 in f7e4526

optimizer.zero_grad()

I was wandering why PEM - backbone does not get updated, although it's parameters are passed in to the optimizer