Metrics in Project Charter
waltz2u opened this issue · 0 comments
Hi Azure Team,
I have some questions about the follwing in the Metrics section in the Project Charter
https://github.com/Azure/Azure-TDSP-ProjectTemplate/blob/master/Docs/Project/Charter.md
What are the qualitative objectives? (e.g. reduce user churn)
What is a quantifiable metric (e.g. reduce the fraction of users with 4-week inactivity)
Quantify what improvement in the values of the metrics are useful for the customer scenario (e.g. reduce the fraction of users with 4-week inactivity by 20%)
What is the baseline (current) value of the metric? (e.g. current fraction of users with 4-week inactivity = 60%)
How will we measure the metric? (e.g. A/B test on a specified subset for a specified period; or comparison of performance after implementation to baseline)
In the example, is it about a classification model for customer churn? Assuming it is, the target variable of the example would be something like customer churn. In item#2 "reduce the fraction of users with 4-week inactivity", how can we decide a quantifiable metric in relation to the target variable (4-week inactivity would be a independent variable while the target is customer churn)?
At which stage in the lifecycle can metric values be measured?
Thank you.
C. D.