Quality score up four points, nobody knows why
Metrics · Quick call · Easy · about 3 minutes
The quarterly business review deck shows the summarisation quality score up four points. Nobody in the room can say what improved, including you, because the score comes from an overlap metric built for a different era. The analytics peer who owns the dashboard is proud of the trend. What do you say, and what would the mistake be?
How to answer a quick call: Say the goal and what a good outcome looks like; Say what you are giving up, and why it is worth it; Say what you would do first, and who has to agree; Name the metric and the threshold that would change your mind.
What this question tests
- Measurement
- Technical Fluency
Related PM interview questions
- Measure the Netflix recommendation system
- Engagement dropped in OneDrive
- Flat blended retention hiding better cohorts
- Measure how satisfied Airbnb hosts are
- Healthy averages hiding a weak second city
- Orders at Swiggy fell 20% in a week