Replicating the bits / dim results in the original VQ-VAE paper

Question

Replicating the bits / dim results in the original VQ-VAE paper

pclucas14 opened this issue 5 years ago · 7 comments

Hi,

thanks for your clean implementation ! I was wondering, have you ever tried to calculate the bits / dimension metric (as in the original paper) ? I've tried to do so using the provided code, and I'm still quite far from the results in the paper. I was hoping maybe you would have some insight to share as to why that is the case.

Thanks!
Lucas

Answer 1 · 2019-06-15T12:46:22.000Z

@pclucas14 I haven't tried to do that but plan to... give me a few days to figure it out... I am trying to compile a table of bits/dim for MNIST/ Fashion-MNIST so I might as well start with this

Answer 2 · 2019-06-15T16:31:20.000Z

great! let me know what you end up getting :)

Answer 3 · 2019-06-15T16:50:10.000Z

Thanks! Here is where I am collecting the results: zalandoresearch/fashion-mnist#144

Answer 4 · 2019-06-17T15:31:53.000Z

great! it's a very complete list, pretty cool :D

Answer 5 · 2019-06-18T17:41:37.000Z

The best I got for VQ-VAE on CIFAR-10 was 5.00 BPD (using a unigram prior). This is still far from the results in the VQ-VAE paper. Hopefully you can manage to close the gap even more :)

Answer 6 · 2020-09-16T09:44:46.000Z

Hi @kashif ,
could you provide the code you use to compute the bpd?

Thanks!

Answer 7 · 2023-04-23T21:06:29.000Z

Wonder if there is code for proper bpd computation? If so, can you please share?