From decisions to metrics, and a definition of activation
Starting from the decision at hand, rather than from the data you happen to have, changes what your team measures and how it reads the results. This lesson helps you set aside flattering numbers that guide no choice and write a definition of activation that the data can confirm or refute. Useful before any onboarding trade-off.
Lesson objective
By the end of this lesson, you will be able to start from a decision to be made to write the questions and metrics that inform it, tell an actionable metric from a vanity metric, and propose a definition of activation that can be checked against the data.
Questions this lesson answers
- How do you tell an actionable metric apart from a vanity metric?
- How do you define user or account activation for a product?
- How do you go from a product decision to the metrics that inform it?
Topics covered
- vanity metrics
- actionable metrics
- activation definition
- decision question
- aha moment
In the glossary
Where it fits
Choose what to measure
Out of everything I could measure, what actually helps the team decide?
Lessons in this module
- North Star, input metrics and guardrails
- From decisions to metrics, and a definition of activation (this lesson)
What you will learn in this module
This lesson is part of the course Instrument a product and use data to make decisions
- Build a product's metrics tree (North Star, input metrics, guardrails) from the decisions to be made, and rule out vanity metrics.
- Turn an analysis into a reasoned decision (dashboard, decision memo) while avoiding interpretation traps (vanity, Simpson, correlation, small counts).
Related courses
- Product ManagementJuniorSome basics are useful: introductory knowledge of the topic.
Design and validate a product experience with AI
2 hr 30 min
- Product ManagementAdvancedRegular practice: you already use the tools or work on this topic.
Write specs that developers and AI agents understand
2 hr 30 min
- Product ManagementAdvancedRegular practice: you already use the tools or work on this topic.
Prioritize and build an outcome-based roadmap
2 hr 30 min