Invalid argument: activation input is not finite. : Tensor had NaN values

Question

Invalid argument: activation input is not finite. : Tensor had NaN values

AlephZr opened this issue 4 years ago · 1 comments

Original stack trace for 'FID_Inception_Net/mixed_5/tower_1/conv_1/CheckNumerics':

I use the version tensorflow 1.14.
This problem appears randomly, maybe in the early stage of training, maybe in the later stage, and it always appears during a certain FID evaluation.

I don't know the reason, but it doesn't seem to be because of the mode collapse, at least the generated sample looks good to the naked eye.Can you help me?

Answer 1 · 2020-09-17T13:38:43.000Z

The sample size is 500,000