Cannot reproduce the result, actually a really bad one if training from scratch
arxrean opened this issue · 1 comments
arxrean commented
Hi Fengdalu,
Thanks for sharing the code. However, if I train the model from scratch without pretrained weights and keep the options same, the result is very bad (like 0.8 WER for test?). Is there any preprocess if I want to train from zero? Thank you!
Fengdalu commented
When start from scratch,the base_lr should be 1e-4 instead of 1e-5.