Calibration/Refinement Decomposition of LOO Scores

Question

Calibration/Refinement Decomposition of LOO Scores

ParadaCarleton opened this issue 3 years ago · 2 comments

I think a breakdown of LOO scores into calibration/refinement would be interesting and useful to users. Mentioning @avehtari because Jonah mentioned you'd proposed adding this decomposition and said you might have some related work.

Answer 1 · 2023-03-24T12:55:05.000Z

@ParadaCarleton can you add here a reference to "calibration/refinement"

Answer 2 · 2023-03-25T21:38:08.000Z

It has now been 2 years and I have no idea what I was talking about then 😄

But I think this was the relevant paper that inspired this suggestion, though I'm not 100% sure.