What are the metrics of the six recipes of Desiderata?

Question

What are the metrics of the six recipes of Desiderata?

zhimin-z opened this issue 10 months ago · 4 comments

I fail to find any of those recipes in the original paper...

Answer 1 · 2023-11-29T19:23:37.000Z

BTW, are those metrics all accuracy?

Answer 2 · 2023-12-04T03:52:02.000Z

Desiderata is a newly proposed evaluation metric in ChEF, focusing on dimensions of capabilities beyond the visual abilities of MLLMs. These metrics include the trustworthiness and interactivity. Please refer to our paper ChEF for more details. Thanks for your interest.

Answer 3 · 2023-12-07T15:30:48.000Z

But I still fail to find this one in terms of the exact evaluation metrics. Is the evaluation result accuracy or not?

Answer 4 · 2023-12-12T14:33:54.000Z

But I still fail to find this one in terms of the exact evaluation metrics. Is the evaluation result accuracy or not?

Any update? @Coach257