Report metrics on popular Vision model benchmark
lucasjinreal opened this issue · 1 comments
lucasjinreal commented
Hi, would consider add some populra vision benchmark metric so that people can estimate the model performance?
Such as MMbench, MME, MMMU etc?
jacobkahn commented
Outside of the benchmarks in the paper, you'll need to run these yourself; we're not running further evaluations.