NannyML/nannyml

[Plotting] How to treat threshold for Chi2 drift detection?

nikml opened this issue · 1 comments

nikml commented

Describe the bug
Changes in main have caused threshold to enter legend in Chi2 drift plots. But given that threshold for Chi2 is based on p-values - which are not plotted - this may confuse the user. Ideally we would not show this - as is the current stable behavior.

Chi2 Drift results in latest.

Chi2 Drift results in stable.

Discussed on Slack: decision is to not display the p-values threshold on the plot, so it should also not be displayed in the legend. This may be revised in future when considering custom thresholds.