Cyclic annealing training
Opened this issue · 0 comments
mu-arkhipov commented
Hello, and thank you for the repo and the paper you published.
I'm struggling to find the cyclic annealing option in the training scripts. Namely, I'm referring to the paper Cyclical annealing schedule: A simple approach to mitigating KL vanishing by Xiaodong Liu et al. Does the code support this annealing schedule?
Thank you.