Measuring Business Value
Introduction
Effective product management requires understanding how to measure the business value created by product initiatives. This note outlines frameworks and approaches for quantifying the impact of product decisions, connecting customer outcomes to business results, and establishing meaningful metrics.
Outcomes vs. Impact
- Outputs (what we build) → Outcomes (behavior change) → Impact (business results)
- Impact is a side effect of well-designed outcomes
- Leaders typically focus on impact, while executors are responsible for outputs and outcomes
- Example Value Chain:
- Impact: Reduce support costs
- Outcome: Fewer people calling tech support
- Output: Improved usability of confusing features
Importance of Outcome Focus
- Focusing on outcomes rather than outputs shifts attention to customer value
- Product teams should be accountable for outcomes, not just shipping features
- Outcomes are more stable than the solutions we might build to achieve them
Indicators and Metrics
Leading vs. Lagging Indicators
- Lagging Indicators: Tell you what happened in the past; examples: revenue, profit, customer satisfaction
- Leading Indicators: Have a proven relationship between an action and a future result; examples: engagement metrics, activation rates
- Leading indicators show if you'll hit or miss the target; lagging indicators reveal the actual target
Product Metrics Frameworks
North Star Metric
- One key indicator reflecting the core value of your product
- Expresses the main long-term goal
- Measures how well the product meets customer needs
- Examples: streaming → viewing hours; SaaS → weekly active users; e-commerce → customer lifetime value
OKR (Objectives - Key Results)
- Objectives are qualitative, inspiring goals
- Key Results are specific metrics that track progress
- Typically used in quarterly cycles
- Focuses teams on outcomes rather than activities
- All KPIs are metrics, but not all metrics are KPIs
- Should be tied to strategic business objectives
Pirate/AARRR Framework
- Acquisition → Activation → Retention → Revenue → Referral
Common Product Metrics
- Conversion Rate: Percentage of visitors who perform a desired action
- Retention Rate: Percentage of customers who return after a certain period
- Churn Rate: Percentage of customers who stop using your product
- CAC: Cost to acquire a new customer
- LTV: Total revenue expected from a customer
Hypothesis-Driven Approach
Effective Hypothesis Structure
- Belief statement: What you believe will work
- Evidence: The data you'll look for to confirm or disprove
- Expected outcome: What success looks like
- Time: Willingness to spend time with you
- Reputation risk: Introducing you to others
- Money: Actual financial investment
- It's not a real lead until you've given them a concrete chance to reject you