facebookresearch/chameleon

Why Answers are different for repeating the same text question + same input image

usajid14 opened this issue · 2 comments

usajid14 commented

Hi,

I have noticed that model answers vary wildly if we repeat the same question + input image. Can you give any insights on the reason behind it? Thank you!

jacobkahn commented

Setting the temperature to 1 should give you repeatable outputs for generation (the default is not 1).

  • 👍1
EntilZha commented

To add a bit more, double check that you're setting the seed to the same value each time.

  • 👍1