soumith/ganhacks

How to handle failure mode

solomatov opened this issue · 3 comments

What's the best practice for handling failure mode, i.e. when the discriminator or the generator has 0 loss. Should we just terminate learning and debug the algorithm? Or should we rollback a couple of epochs back and continue training from there?

@solomatov : Do you find the solution? I have same issue as you

@John1231983 No, eventually I fixed the algorithm, but I don't remember what I did there.