bohanli/vae-pretraining-encoder

Cyclic annealing training

Opened this issue · 0 comments

Hello, and thank you for the repo and the paper you published.
I'm struggling to find the cyclic annealing option in the training scripts. Namely, I'm referring to the paper Cyclical annealing schedule: A simple approach to mitigating KL vanishing by Xiaodong Liu et al. Does the code support this annealing schedule?
Thank you.