Hzfinfdu/Diffusion-BERT

Function missed

Closed this issue · 2 comments

This work is fascinating and attractive, however, I have an issue when I read the code.
Line 511 in diffusion_word_freq.py "schedule_fn = utils.create_learning_rate_scheduler(" calls the function create_learning_rate_scheduler in file utils.py. But I don't find the definition in utils.py, maybe the code is incomplete?
Thanks.

Hi,

Thanks for following our work. This is because we did not experiment on linear schedule. Since our code is copied from D3PM, you can find the JAX version of this function in this file and add the paraphrased torch version into utils.py. Hope this helps.

Thanks for your response, it's very useful for understanding.