sbarratt/inception-score-pytorch

Use cifar10 datasets get score 5.63 ?

odie2630463 opened this issue · 4 comments

odie2630463 commented

Hi , i try cifar10 datasets get score 5.63 , but other code get about 12
Is there some thing wrong ? thanks !

simopal6 commented

@sbarratt I read the paper but couldn't find an explanation to @odie2630463's question. Indeed, using your code I obtained an Inception score of 6.19 on CIFAR-10, but even you report results between 9 and 11...

  • 👍2
sbarratt commented

See 3bcf441, which sets transform_input=False. That is required to get the same results.

  • 👍1
bknyaz commented

My inception score for CIFAR-10 using this implementation is 9.86.
Using normalization values as suggested in pytorch docs helped me to increase the score up to 10.56, but is still below the tensorflow results, which must be around 11.24 according to https://arxiv.org/pdf/1606.03498.pdf. I think the reason for this gap is that the model in pytorch makes slightly different predictions for the same images.

  • 👍8