BAAI-DCAI/Bunny

obtain the log probabilities of output tokens

Closed this issue · 2 comments

Yuxin916 commented

Hi! Thank you for providing this framework. I found it very useful and helpful!

I am new to VLM domain and currently using SigLip vison encoder and Phi-2 LLM as main components on my task. I was wondering how can i obtain the log probabilities of output tokens after i called model.generate()? Do you have any suggestions on how to call on or where could i develop on this?

Best Regards

Isaachhh commented

There is a related issue #62.

And you may refer to logits.

  • 👍1
Yuxin916 commented

Thank you! The problem is solved.