Some questions about this code.
Haoqing-Wang opened this issue · 1 comments
-
When calculating the calibration, why it adds some noise to the target in regression?
Like this,
outputs = outputs + (self.noise_std2)output_noises*
And should it be
outputs = outputs + self.noise_std*output_noises -
As we all know, MAML can only calculate one value for a input, then how can it calculate the reliability diagram like fig 2(c) in you paper?
Thank you very much for your kind consideration and I am looking forward to your early reply.
Thank you @Haoqing-Wang for spotting the mistake. I have corrected.
To calculate the quantile calibration of MAML for regression, we simply calculate as the definition of quantile calibration. Note that MAML results in a point estimation, its predicted quantiles are the same, and so are the ground truth quantiles. Its performance curve is, therefore, a horizontal line going through that single point (which will be corrected in my camera-ready paper).