QwenLM/Qwen2-VL

VQA Score support

Dratlan opened this issue · 1 comments

Dratlan commented

Hi. I wonder can we get VQA Score from Qwen2-VL like the way in:
https://github.com/linzhiqiu/t2v_metrics
It seems that Qwen2-vl can only answer with 'yes' or 'no', but not score.

Many thanks!

yhy-2000 commented

same question, when I try to output_scores/output_logits, the logits is -nan and all outputs turn to 'A'.