Product Analytics
Data-driven product decisions
Full ArticleProduct Analytics
How Revolut Used Rapid Experimentation to Disrupt Traditional Banking
Revolut grew to over 30 million customers by shipping features at a pace unheard of in banking. This case study examines how the fintech challenger built an experimentation culture, used feature flags and gradual rollouts to manage risk in a regulated industry, and applied product-led growth principles to financial services.
Harvard Business Review·14 min read·Jan 1, 2023
Full ArticleProduct Analytics
How Spotify Uses Data to Make Product Decisions: Wrapped and Discover Weekly
Spotify's Discover Weekly and Wrapped features are masterclasses in using data to create delightful product experiences. This case study examines how the data science and product teams collaborate, how Discover Weekly's recommendation engine was built by a small team in a hackathon, and how Wrapped turned personal data into a viral annual marketing event.
HBS Working Knowledge·15 min read·Jan 1, 2023
Full ArticleProduct Analytics
Observability: More Than Just Three Pillars
Why true observability requires more than logs, metrics, and traces — and how to build systems that let you ask arbitrary questions about production behavior.
Classic Articles·8 min read·Jan 1, 2023
Full ArticleProduct Analytics
Engineering Metrics That Drive Improvement
How to measure engineering team performance without destroying morale — focusing on system-level metrics, delivery performance, and developer satisfaction rather than individual output.
Classic Articles·8 min read·Jan 1, 2023
Full ArticleProduct Analytics
Growth Hacking: The Systematic Pursuit of Scalable Growth
Growth hacking is not a bag of tricks — it is a disciplined process of hypothesis generation, rapid experimentation, and data-driven iteration focused on growth metrics. This article traces the origin of the growth hacking movement from Sean Ellis through the growth teams at Facebook, Airbnb, and Dropbox. It covers the growth funnel (acquisition, activation, retention, referral, revenue), the process of running growth experiments, and the organizational design required to sustain a growth practice. The emphasis is on sustainable, ethical growth through product improvement rather than manipulative tactics.
First Round Review·15 min read·Jan 1, 2023
Full ArticleProduct Analytics
The Art and Science of Survey Design: Getting Reliable Data from Questions
Surveys are the most widely used — and most widely abused — research instrument in business. Poorly designed surveys produce misleading data that can drive costly decisions. This article covers the principles of rigorous survey design: writing unbiased questions, choosing appropriate scales, avoiding leading and double-barreled questions, managing survey length, and sampling strategies. It also covers analysis techniques including how to handle response bias, calculate confidence intervals, and distinguish meaningful differences from noise.
Nielsen Norman Group·12 min read·Jan 1, 2023
Full ArticleProduct Analytics
How Duolingo Uses Gamification and A/B Testing to Drive Language Learning
Duolingo runs thousands of A/B tests simultaneously to optimize its gamification mechanics, from streak counts to leaderboards to animated characters. This case study explores how the company's growth team uses experimentation infrastructure, behavioral psychology, and game design to maintain daily active users in the hundreds of millions.
Harvard Business Review·15 min read·Jan 1, 2023
Full ArticleProduct Analytics
Confirmation Bias in Data Analysis: Seeing What You Want to See
Even data-driven organizations fall prey to confirmation bias when analysts seek, interpret, and remember data that supports pre-existing beliefs while ignoring contradictory evidence. Davenport's research shows that teams given the same dataset reach conclusions aligned with their prior hypotheses 73% of the time. The article prescribes adversarial analysis practices, blind data exploration, and red team reviews that systematically challenge analytical conclusions before they inform decisions.
Harvard Business Review·11 min read·Aug 16, 2021
Full ArticleProduct Analytics
Cohort Analysis: The Key to Understanding User Behavior Over Time
Madhavan explains how cohort analysis segments users by shared characteristics or time periods to reveal behavioral patterns hidden in aggregate data. The article walks through practical examples of retention cohorts, behavioral cohorts, and acquisition cohorts, demonstrating how each reveals different insights for product and growth teams.
Classic Articles·12 min read·Mar 15, 2021
Full ArticleProduct Analytics
Product Analytics: Measuring What Matters for Product Teams
Outlines a framework for selecting and tracking the metrics that genuinely reflect product health, distinguishing between vanity metrics and actionable indicators. Covers retention analysis, engagement scoring, and how to build a metrics hierarchy that connects daily team activities to company-level outcomes.
First Round Review·12 min read·Aug 20, 2020
Full ArticleProduct Analytics
Bayesian Thinking for Business: Updating Beliefs with Evidence
Bayesian reasoning offers a formal framework for updating beliefs as new evidence arrives, combating both stubbornness and overreaction to new data. This article translates Bayesian principles into practical business applications including A/B test interpretation, market forecasting, and competitive intelligence. Teams that adopt probabilistic thinking make better decisions under uncertainty and communicate assumptions more transparently.
MIT Sloan Management Review·14 min read·Aug 3, 2020
Full ArticleProduct Analytics
Unit Economics: The Foundation of Sustainable Growth
Andreessen Horowitz explains why unit economics, particularly LTV/CAC ratios and contribution margins, are the most critical metrics for evaluating business viability. The article provides frameworks for calculating unit economics across different business models and explains how investors use these metrics to distinguish sustainable growth from subsidized growth.
Classic Articles·10 min read·Jun 1, 2020
Full ArticleProduct Analytics
Framing Effects: How the Same Data Tells Different Stories
Whether a medical procedure is described as having a 90% survival rate or a 10% mortality rate dramatically changes decisions, even among trained professionals. This article examines framing effects across business contexts including product marketing, investor communications, and internal reporting. Leaders who understand framing can present information more honestly while stakeholders can guard against manipulation.
MIT Sloan Management Review·11 min read·May 18, 2020
Full ArticleProduct Analytics
Dashboard Design Patterns: How to Create Effective Data Displays
Kaley synthesizes UX research on effective dashboard design, covering information hierarchy, progressive disclosure, and the cognitive principles that determine whether dashboards help or hinder decision-making. The article provides practical guidelines for choosing chart types, managing visual complexity, and designing for different user contexts.
Nielsen Norman Group·11 min read·Apr 19, 2020
Full ArticleProduct Analytics
Creating a Data-Driven Culture: It's Not About the Technology
Davenport examines the evolving role of Chief Data Officers and why most organizations struggle to become truly data-driven despite massive technology investments. The article argues that building a data culture requires leadership commitment, data literacy programs, and organizational structures that embed data-informed decision-making into daily workflows.
Harvard Business Review·10 min read·Feb 1, 2020
Full ArticleProduct Analytics
TAM SAM SOM: How to Size Your Market Like a Pro
This guide breaks down the TAM/SAM/SOM framework for market sizing, explaining both top-down and bottom-up approaches with practical examples. The article demonstrates how to construct credible market size estimates that withstand investor scrutiny, avoiding common traps like citing overly broad industry reports.
First Round Review·10 min read·Apr 22, 2019
Full ArticleProduct Analytics
Choosing the Right Metrics: How to Avoid the Vanity Trap
Sull and Sull challenge the ubiquitous SMART goals framework and propose FAST goals (Frequently discussed, Ambitious, Specific, Transparent) as a more effective alternative. The research shows that transparent, frequently reviewed goals with ambitious targets drive significantly better organizational performance than the conventional approach.
MIT Sloan Management Review·10 min read·Jun 5, 2018
Full ArticleProduct Analytics
How Superhuman Built an Engine to Find Product/Market Fit
A step-by-step framework for measuring and optimizing product/market fit using the Sean Ellis test, user segmentation, and a systematic approach to building what users love.
Classic Articles·23 min read·Jun 1, 2018
Full ArticleProduct Analytics
SaaS Metrics 2.0: A Guide to Measuring and Improving What Matters
Skok provides the definitive guide to SaaS metrics, covering MRR, ARR, churn, LTV, CAC, and the benchmarks that indicate healthy SaaS businesses. The comprehensive framework helps both operators and investors evaluate SaaS companies using the metrics that actually predict long-term success and capital efficiency.
Classic Articles·22 min read·Feb 15, 2018
Full ArticleProduct Analytics
A/B Testing: A Complete Guide to Designing and Analyzing Experiments
Kohavi and Thomke explain how controlled online experiments (A/B tests) enable data-driven product decisions at scale. Covers experimental design, statistical significance, common pitfalls like peeking at results too early, and how companies like Microsoft and Booking.com run thousands of experiments annually.
Harvard Business Review·15 min read·Sep 1, 2017