How do I use dropout?

Question

fanlu opened this issue 7 years ago · 3 comments

I found that there are several places where you can dropout, what experience do you have?

Answer 1 · 2017-07-14T04:31:34.000Z

In deep speech 2 paper, they didn't use dropout but if many users want it's not need much work because we already using drop out in other project.

Answer 2 · 2017-07-14T05:43:48.000Z

Do you know what other regularized skills they use?

Answer 3 · 2017-07-17T00:57:38.000Z

I assume that batch normalization can do regularization. please see this paper's section 3.4 https://arxiv.org/pdf/1502.03167.pdf