Add telemetry to measure success
Opened this issue · 0 comments
Use Azure Application Insights or something similar to log metrics to indicate success towards goals. All confirmed metrics should be available by State, Language, and Program (WIC, SNAP, etc.) - maybe add as filters.
User Impact: As a user
It takes me less time to find my eligibility, relevant programs and apply for food assistance programs in my geo.
Metric: Avg. Time on App (Get Started click to completion time) -- P0
I can find my eligibility and apply to programs without having too much back and forth with the bot.
Metric: Positive/Negative Sentiment Score -- P1
I am satisfied with my experience.
Metric: CSAT Score/Net Promoter Score – P0
Adoption: As a Share our Strength member
We know that users are widespread across the US and are actively using the app.
Metrics:
- Total Visits at beginning of app interaction (use clicks on “Get Started”?) -- P0
- Total Visits at end of app interaction (use clicks in image below as completion – this is assuming that once a user clicks on any of these actions, they have gone through all the use cases the app was built for and will continue to the next step?) -- P0
Our team is confident that we were able to help users find their eligibility and programs.
Metrics:
- % visitors who completed eligibility check & total #s (use clicks on submitting the questionnaire by clicks on “Get Started”) -- P0
- % of visitors who were eligible & total #s -- P1
- % visitors who completed program search & total #s (use clicks in image below as program search completion by clicks on “Get Started” aka total initial visits or total eligible visits) -- P0
Our team can measure and understand the cost of the app.
Metric: Cost by chosen time period -- P0