Prep RoomSign inStart free

Metrics deep-dive questions.

75 metrics deep-dive questions from the bank, ready to practice out loud.

Practice metrics deep-dive

Learn the ideas first · free with an account

Funnel metrics and conversion decompositionSTAR and CARL: structuring your storyCohort analysis and retention curvesGuardrail metrics and healthy growthNorth-star metrics and metric treesProduct judgment when the data disagreesSegmenting a metric move: mix shift and Simpson's paradoxUnit economics: CAC, LTV, and payback

All 75 questions

Streaming homepage primary metricYou're the PM for the homepage of a streaming service. What's your one primary metric and what guardrails go around it?Choosing primary vs guardrail metricsMid–senior
Two metrics for B2B SaaSIf you only had two metrics to track for a B2B SaaS team, what would they be and why?Leading vs lagging indicatorsSenior–staff+
Bimodal retention user segmentationWalk me through how you'd segment users for a product whose retention is bimodal — half churn fast, half stay forever.Segmentation strategySenior–staff+
North Star metric growth concernsYour team's North Star metric is up 15% this quarter. What specific result would make you worry?What bad numbers would tell youSenior–staff+
Payments API metrics frameworkDesign the metrics framework for a payments API. What are you measuring beyond uptime?Choosing primary vs guardrail metricsSenior–staff+
Subscription churn leading indicatorsWhat leading indicators would you watch for churn on a consumer subscription product?Leading vs lagging indicatorsMid–senior
Two-sided marketplace engagement metricsIf you had to track engagement for a marketplace with two sides, walk me through what you'd measure for each side and why they aren't the same.Segmentation strategySenior–staff+
DAU increase with session dropWalk me through what you would and wouldn't conclude if your daily active users went up 5% but session length dropped 10%.What bad numbers would tell youMid–senior
Developer tool success metricsDesign the metrics for a developer-tool team where their users are engineers. What does success look like?Choosing primary vs guardrail metricsSenior–staff+
Platform trust metric signalsWhat metrics would tell you that the trust between your platform and its users is changing, before retention moves?Leading vs lagging indicatorsSenior–staff+
Free tier effectiveness metricsYour product has a free tier. What metrics tell you the free tier is doing its job?Segmentation strategySenior–staff+
Product winning signal changesWalk me through what specific signals would change your view that your product is winning.What bad numbers would tell youSenior–leadership
AI feature helpfulness measurementDesign the success metrics for an AI feature shipped inside an existing product. What does 'helpful' actually mean here?Choosing primary vs guardrail metricsSenior–staff+
Six-month revenue prediction metricYour CFO wants a weekly metric that predicts revenue six months out. What would you propose and what's its limitation?Leading vs lagging indicatorsSenior–leadership
B2B activation with split usersHow would you measure activation for a B2B product where the buyer and the daily user are different people?Segmentation strategySenior–staff+
Early goal achievement validationYour team's metric hit its quarterly goal early. What checks would you run before declaring success?What bad numbers would tell youSenior–staff+
Vanity versus real feed metricsWhat's the difference between a vanity metric and a real one for a social feed product?Choosing primary vs guardrail metricsMid–senior
Payments executive dashboard designDesign a small dashboard of three metrics for an executive on a payments team. What goes on it?Leading vs lagging indicatorsSenior–leadership
Retention feature success definitionHow would you define and measure success for a feature aimed at retention rather than acquisition?Segmentation strategySenior–staff+
Defendable core metric choiceAn exec asks 'what's the one metric you'd defend?' What's yours, and what would you accept as evidence to swap it?What bad numbers would tell youSenior–leadership
Primary metric for search productsWhat's the right primary metric for a search product, and what's a common wrong one?Choosing primary vs guardrail metricsSenior–staff+
Predicting next quarter's revenueIf you had to predict next quarter's revenue from this week's metrics, what would you watch and why?Leading vs lagging indicatorsSenior–leadership
Measuring brand campaign impactWalk me through how you'd measure the impact of a brand campaign on a digital product.Segmentation strategySenior–leadership
Detecting hollow growth signalsYour North Star metric has been growing steadily for a year. What signal would tell you growth is becoming hollow?What bad numbers would tell youSenior–leadership
Metrics for customer support teamsDesign the metrics for a customer-support team. The team will be evaluated on them.Choosing primary vs guardrail metricsSenior–staff+
Leading indicators you trust mostWhat's a leading indicator you trust more than the metric it's predicting? Walk me through why.Leading vs lagging indicatorsSenior–leadership
Measuring internal tooling successHow would you measure the success of an internal tooling team whose users are other employees?Segmentation strategySenior–staff+
Metric improvement vs. user harmYour team's metric will improve by 20% if you ship a feature that you think is bad for users. What do you do?What bad numbers would tell youSenior–leadership
Metrics for an unfamiliar productPick a product you don't work on. Walk me through the metrics you'd set if you owned it tomorrow.Choosing primary vs guardrail metricsSenior–leadership
Overrated metrics in your spaceWhat's a metric most teams in your space track that you think is overrated, and what would you watch instead?Leading vs lagging indicatorsSenior–leadership
Photo-sharing app metrics and guardrailsYou're building a photo-sharing app for close friends. What's your primary metric, and name two guardrails you'd track to make sure growth is healthy?Choosing primary vs guardrail metricsEntry–mid
Unhealthy growth in food deliveryYour food delivery app's order volume is up 20% month-over-month. What's one metric you'd check to see if this growth might be unhealthy?What bad numbers would tell youEntry–mid
Predicting note-taking app retentionYou're tracking user engagement for a note-taking app. What's one leading indicator you'd watch to predict whether users will still be active in 30 days?Leading vs lagging indicatorsEntry–mid
Segmenting fitness app usersYour fitness app has users who work out daily and users who work out once a week. Walk me through one way you'd segment them and why it matters for measuring success.Segmentation strategyEntry–mid
Ride-sharing primary and guardrail metricsYou're the PM for a ride-sharing app. If you could only pick one primary metric and one guardrail metric, what would they be?Choosing primary vs guardrail metricsEntry–mid
Predicting e-commerce checkout improvementYour e-commerce checkout flow has a 60% completion rate. What's one early-funnel metric you'd track to predict whether this will improve or get worse?Leading vs lagging indicatorsEntry–mid
Referral program growth sustainabilityYou launch a referral program and your sign-ups double. Name one metric that would make you concerned this growth won't stick.What bad numbers would tell youEntry–mid
Segmenting podcast listener behaviorsYour podcast app has listeners who binge full series and listeners who sample many shows. How would you segment these groups, and what different metrics matter for each?Segmentation strategyEntry–mid
Guardrails for budgeting app valueYou're building a budgeting app. What's one guardrail metric you'd track alongside monthly active users to ensure you're building something valuable?Choosing primary vs guardrail metricsEntry–mid
Assessing language-learning user qualityYour language-learning app sees a spike in new users every January. What metric would you watch in February to know if these users are high-quality?Leading vs lagging indicatorsEntry–mid
Job-search application rate concernsYour job-search platform's application rate is at an all-time high. What's one number that would tell you this might actually be a problem?What bad numbers would tell youEntry–mid
Segmenting recipe app user expertiseYou run a recipe app used by both beginners and experienced cooks. Walk me through how you'd segment these users and what one different metric you'd prioritize for each group.Segmentation strategyEntry–mid
Credit card product success metricsYou're launching a credit card product. Walk me through your primary success metric and the three most important guardrails you'd put around it.Choosing primary vs guardrail metricsMid–senior
Low core workflow adoption patternYour enterprise SaaS product has 30% of users logging in weekly but only 8% using the core workflow. What does this pattern tell you and what would you measure next?What bad numbers would tell youMid–staff+
Healthcare scheduling metrics frameworkDesign a metrics framework for a healthcare appointment scheduling platform. What are you optimizing for when patients and providers have different definitions of success?Choosing primary vs guardrail metricsSenior–leadership
Adoption plateau signalsYou're tracking feature adoption for a new AI model API. What leading indicators would tell you adoption will plateau before usage numbers actually flatten?Leading vs lagging indicatorsMid–senior
Segmenting mobile app retention breakdownYour mobile gaming app has strong Day 1 retention (85%) but weak Day 7 (22%). Walk me through how you'd segment users to understand what's breaking down.Segmentation strategyMid–senior
Conversion up but LTV downIf conversion rate is up 8% but customer lifetime value is down 12%, what are the three hypotheses you'd investigate first?What bad numbers would tell youSenior–leadership
Metrics for fraud detection tradeoffsYou're building metrics for a fraud detection system. What do you measure when false positives hurt revenue and false negatives hurt trust?Choosing primary vs guardrail metricsSenior–leadership
Seller verification impact on marketplaceYour B2C marketplace added seller verification. Buyer complaints dropped 40% but transaction volume dropped 15%. What would you conclude and what wouldn't you conclude?What bad numbers would tell youMid–senior
Leading indicators for social viralityWalk me through the leading indicators you'd track for organic growth on a social product before virality actually shows up in new user numbers.Leading vs lagging indicatorsMid–staff+
Quality deterioration in manufacturingYou're PM for a pharmaceutical manufacturing line. What metrics tell you quality is deteriorating before defects reach patients?Leading vs lagging indicatorsSenior–leadership
Optimizing for edtech usage segmentsYour edtech product has cohorts clustered into three distinct usage patterns. How would you decide which segment to optimize for and what would make you change that decision?Segmentation strategySenior–leadership
Single metric for subscription paywallIf you could only A/B test one metric for a subscription paywall, what would it be and what critical signal would you lose by ignoring everything else?Choosing primary vs guardrail metricsMid–senior
On-time delivery vs satisfaction disconnectYour logistics platform shows on-time delivery at 94% but customer satisfaction scores are dropping. Walk me through how you'd segment the data to find what's driving the disconnect.Segmentation strategyMid–senior
Mandatory HR tool adoption metricsDesign the metrics for an internal HR tool used by recruiters. What does adoption look like when usage is mandatory but value isn't guaranteed?Choosing primary vs guardrail metricsMid–senior
Uptime not translating to retentionYour cloud infrastructure product has 99.95% uptime but customer renewals are declining. What metrics would you examine to understand why reliability isn't translating to retention?What bad numbers would tell youSenior–leadership
Leading indicators for funnel degradationWalk me through what leading indicators would tell you that your freemium conversion funnel is about to get worse before conversion rate actually drops.Leading vs lagging indicatorsMid–senior
Healthy vs problematic tier cannibalizationYou're launching a premium tier for a consumer app. What metrics tell you cannibalization of your base tier is healthy vs. problematic?What bad numbers would tell youSenior–leadership
High usage low completion segmentationYour consulting project tracking tool shows high daily usage but low project completion rates. How would you segment users to understand who's getting value vs. who's just checking in?Segmentation strategyMid–senior
Referral program optimization and guardrailsIf you had to pick two metrics for a referral program—one to optimize and one as a guardrail—what would they be and why isn't quality vs. quantity the right frame?Choosing primary vs guardrail metricsMid–senior
Power users vs middleYour investment research platform has power users reading 50+ reports monthly and casual users reading 2. Walk me through how you'd decide whether to build for the middle or double down on the extremes.Segmentation strategySenior–leadership
API developer experience degradation signalsWhat metrics would tell you that your API developer experience is degrading before developers actually start churning or complaining?Leading vs lagging indicatorsMid–senior
Biotech lab management metrics frameworkDesign a metrics framework for a biotech lab management system. What does success look like when your users are scientists and compliance is non-negotiable?Choosing primary vs guardrail metricsSenior–leadership
High null rate search behaviorYour search feature has a 45% null result rate but users keep searching. How would you segment search behavior to understand whether this is a problem or not?Segmentation strategyEntry–mid
Enterprise deal velocity leading indicatorsWalk me through the leading indicators you'd monitor to predict enterprise deal velocity is slowing before your sales pipeline metrics actually reflect it.Leading vs lagging indicatorsSenior–leadership
Primary metric for monthly closeYou own the monthly close for a global company. What single primary metric would you run the close on, and what guardrails stop it from being gamed?Choosing primary vs guardrail metricsSenior–staff+
Revenue growth with extended DSORevenue is up 10% year over year, and DSO went from 45 to 68 days. What combinations of numbers would tell you this is a real problem rather than growth noise?What bad numbers would tell youMid–senior
Two metrics for earnings qualityIf you could track only two metrics to judge the earnings quality of a business unit, which would you pick and why?Leading vs lagging indicatorsMid–senior
Segmenting gross margin varianceConsolidated gross margin missed plan by three points this month. Walk me through how you'd segment the variance to find out what actually happened.Segmentation strategyMid–senior
Primary metric for wealth managementYou run a wealth management business. What's your one primary metric, and what guardrails go around it?Choosing primary vs guardrail metricsMid–senior
Leading indicators of fund redemptionsFund performance has been trailing peers for four quarters. Net outflows haven't started yet. What leading indicators of redemptions do you track, and why?Leading vs lagging indicatorsMid–senior
Fund investor redemption risk segmentationWalk me through how you'd segment a fund's investor base to understand redemption risk.Segmentation strategySenior–staff+
Concerning details in strong performanceYour flagship fund beat its benchmark by 300 basis points this year. What specific result in the detail would worry you?What bad numbers would tell youSenior–staff+
Primary metric for fund operationsYou own the operations dashboard for a fund administration business. Pick your primary operational health metric and the guardrails around it.Choosing primary vs guardrail metricsMid–senior