Previous
¶ Data Performance Review
¶ What it is
After collecting all necessary data, we will conduct a data performance review to understand whether data performance is within expectation and sufficient for us to decide on appropriate next steps. Based on the story, the data tells us we can start moving forward with product decisions or arrange to collect more data (over extended periods or other data points).
¶ Why it is useful
Data performance reviews are essential to gather all relevant information, make decisions and align internally.
¶ When to use it & Who is involved
Data performance reviews should happen regularly (e.g., every week or every second week) with the relevant members from the business analysis, technical, design, and business teams.
¶ How is it done
- Set up a regular appointment for the data review with the relevant team members. Prepare the data beforehand and share it before the meeting as a pre-read.
- During the meeting, run through the relevant data points and discuss whether the performance is on-track as expected or whether there are metrics that are over- or underperforming.
- Discuss relevant decisions to get back on track with underperforming metrics. Use additional data points to uncover where problems might be located and use the 5 Whys or Iceberg method to dig into root causes. Discuss how to address root causes.
- Review the performance plan for the next month and whether metrics growth, even for on-track metrics, is at the proper levels. Ensure you have all actions to meet the goal for the subsequent two cycles.
¶ Do's & Don't
Do's
- Provide a pre-read before the session to ensure everyone comes prepared.
- Be prepared to provide more deep dives on the spot from your analytics system. Only some things can be prepared in the report, but having data on hand will help discussions.
- Brainstorm broadly on actions, don’t jump to the first thought and move on. Utilise creative techniques from Phase 2 to guide ideation.
Don't
- Avoid jumping to conclusions based on single metrics. Explore broadly what story different indicators tell you.
¶ Tools needed
- Data tracking report
- Virtual whiteboard to ideate and take notes