Cosine scheduler gives much worse results

[MoayedHajiAli]

I noticed that you have implemented cosine scheduler in your codebase. However, when training with it, the model performs poorly. I am wondering if you have similar experience when testing with the cosine scheduler or whether I might be doing something wrong?
Thank you for your help!