Sign in Create account

Metrics deep-dive questions.

75 metrics deep-divequestions from the bank — open to read. Pick one and practice it out loud; a coach note comes back in seconds.

Practice metrics deep-dive

Learn the ideas first

Funnel metrics and conversion decomposition Cohort analysis and retention curves Guardrail metrics and healthy growth North-star metrics and metric trees Segmenting a metric move: mix shift and Simpson's paradox Unit economics: CAC, LTV, and payback

All 75 questions

You're the PM for the homepage of a streaming service. What's your one primary metric and what guardrails go around it?Choosing primary vs guardrail metricsMid–senior If you only had two metrics to track for a B2B SaaS team, what would they be and why?Leading vs lagging indicatorsSenior–staff+Walk me through how you'd segment users for a product whose retention is bimodal — half churn fast, half stay forever.Segmentation strategySenior–staff+Your team's North Star metric is up 15% this quarter. What specific result would make you worry?What bad numbers would tell youSenior–staff+Design the metrics framework for a payments API. What are you measuring beyond uptime?Choosing primary vs guardrail metricsSenior–staff+What leading indicators would you watch for churn on a consumer subscription product?Leading vs lagging indicatorsMid–senior If you had to track engagement for a marketplace with two sides, walk me through what you'd measure for each side and why they aren't the same.Segmentation strategySenior–staff+Walk me through what you would and wouldn't conclude if your daily active users went up 5% but session length dropped 10%.What bad numbers would tell youMid–senior Design the metrics for a developer-tool team where their users are engineers. What does success look like?Choosing primary vs guardrail metricsSenior–staff+What metrics would tell you that the trust between your platform and its users is changing, before retention moves?Leading vs lagging indicatorsSenior–staff+Your product has a free tier. What metrics tell you the free tier is doing its job?Segmentation strategySenior–staff+Walk me through what specific signals would change your view that your product is winning.What bad numbers would tell youSenior–leadership Design the success metrics for an AI feature shipped inside an existing product. What does 'helpful' actually mean here?Choosing primary vs guardrail metricsSenior–staff+Your CFO wants a weekly metric that predicts revenue six months out. What would you propose and what's its limitation?Leading vs lagging indicatorsSenior–leadership How would you measure activation for a B2B product where the buyer and the daily user are different people?Segmentation strategySenior–staff+Your team's metric hit its quarterly goal early. What checks would you run before declaring success?What bad numbers would tell youSenior–staff+What's the difference between a vanity metric and a real one for a social feed product?Choosing primary vs guardrail metricsMid–senior Design a small dashboard of three metrics for an executive on a payments team. What goes on it?Leading vs lagging indicatorsSenior–leadership How would you define and measure success for a feature aimed at retention rather than acquisition?Segmentation strategySenior–staff+An exec asks 'what's the one metric you'd defend?' What's yours, and what would you accept as evidence to swap it?What bad numbers would tell youSenior–leadership What's the right primary metric for a search product, and what's a common wrong one?Choosing primary vs guardrail metricsSenior–staff+If you had to predict next quarter's revenue from this week's metrics, what would you watch and why?Leading vs lagging indicatorsSenior–leadership Walk me through how you'd measure the impact of a brand campaign on a digital product.Segmentation strategySenior–leadership Your North Star metric has been growing steadily for a year. What signal would tell you growth is becoming hollow?What bad numbers would tell youSenior–leadership Design the metrics for a customer-support team. The team will be evaluated on them.Choosing primary vs guardrail metricsSenior–staff+What's a leading indicator you trust more than the metric it's predicting? Walk me through why.Leading vs lagging indicatorsSenior–leadership How would you measure the success of an internal tooling team whose users are other employees?Segmentation strategySenior–staff+Your team's metric will improve by 20% if you ship a feature that you think is bad for users. What do you do?What bad numbers would tell youSenior–leadership Pick a product you don't work on. Walk me through the metrics you'd set if you owned it tomorrow.Choosing primary vs guardrail metricsSenior–leadership What's a metric most teams in your space track that you think is overrated, and what would you watch instead?Leading vs lagging indicatorsSenior–leadership You're building a photo-sharing app for close friends. What's your primary metric, and name two guardrails you'd track to make sure growth is healthy?Choosing primary vs guardrail metricsEntry–mid Your food delivery app's order volume is up 20% month-over-month. What's one metric you'd check to see if this growth might be unhealthy?What bad numbers would tell youEntry–mid You're tracking user engagement for a note-taking app. What's one leading indicator you'd watch to predict whether users will still be active in 30 days?Leading vs lagging indicatorsEntry–mid Your fitness app has users who work out daily and users who work out once a week. Walk me through one way you'd segment them and why it matters for measuring success.Segmentation strategyEntry–mid You're the PM for a ride-sharing app. If you could only pick one primary metric and one guardrail metric, what would they be?Choosing primary vs guardrail metricsEntry–mid Your e-commerce checkout flow has a 60% completion rate. What's one early-funnel metric you'd track to predict whether this will improve or get worse?Leading vs lagging indicatorsEntry–mid You launch a referral program and your sign-ups double. Name one metric that would make you concerned this growth won't stick.What bad numbers would tell youEntry–mid Your podcast app has listeners who binge full series and listeners who sample many shows. How would you segment these groups, and what different metrics matter for each?Segmentation strategyEntry–mid You're building a budgeting app. What's one guardrail metric you'd track alongside monthly active users to ensure you're building something valuable?Choosing primary vs guardrail metricsEntry–mid Your language-learning app sees a spike in new users every January. What metric would you watch in February to know if these users are high-quality?Leading vs lagging indicatorsEntry–mid Your job-search platform's application rate is at an all-time high. What's one number that would tell you this might actually be a problem?What bad numbers would tell youEntry–mid You run a recipe app used by both beginners and experienced cooks. Walk me through how you'd segment these users and what one different metric you'd prioritize for each group.Segmentation strategyEntry–mid You're launching a credit card product. Walk me through your primary success metric and the three most important guardrails you'd put around it.Choosing primary vs guardrail metricsMid–senior Your enterprise SaaS product has 30% of users logging in weekly but only 8% using the core workflow. What does this pattern tell you and what would you measure next?What bad numbers would tell youMid–staff+Design a metrics framework for a healthcare appointment scheduling platform. What are you optimizing for when patients and providers have different definitions of success?Choosing primary vs guardrail metricsSenior–leadership You're tracking feature adoption for a new AI model API. What leading indicators would tell you adoption will plateau before usage numbers actually flatten?Leading vs lagging indicatorsMid–senior Your mobile gaming app has strong Day 1 retention (85%) but weak Day 7 (22%). Walk me through how you'd segment users to understand what's breaking down.Segmentation strategyMid–senior If conversion rate is up 8% but customer lifetime value is down 12%, what are the three hypotheses you'd investigate first?What bad numbers would tell youSenior–leadership You're building metrics for a fraud detection system. What do you measure when false positives hurt revenue and false negatives hurt trust?Choosing primary vs guardrail metricsSenior–leadership Your B2C marketplace added seller verification. Buyer complaints dropped 40% but transaction volume dropped 15%. What would you conclude and what wouldn't you conclude?What bad numbers would tell youMid–senior Walk me through the leading indicators you'd track for organic growth on a social product before virality actually shows up in new user numbers.Leading vs lagging indicatorsMid–staff+You're PM for a pharmaceutical manufacturing line. What metrics tell you quality is deteriorating before defects reach patients?Leading vs lagging indicatorsSenior–leadership Your edtech product has cohorts clustered into three distinct usage patterns. How would you decide which segment to optimize for and what would make you change that decision?Segmentation strategySenior–leadership If you could only A/B test one metric for a subscription paywall, what would it be and what critical signal would you lose by ignoring everything else?Choosing primary vs guardrail metricsMid–senior Your logistics platform shows on-time delivery at 94% but customer satisfaction scores are dropping. Walk me through how you'd segment the data to find what's driving the disconnect.Segmentation strategyMid–senior Design the metrics for an internal HR tool used by recruiters. What does adoption look like when usage is mandatory but value isn't guaranteed?Choosing primary vs guardrail metricsMid–senior Your cloud infrastructure product has 99.95% uptime but customer renewals are declining. What metrics would you examine to understand why reliability isn't translating to retention?What bad numbers would tell youSenior–leadership Walk me through what leading indicators would tell you that your freemium conversion funnel is about to get worse before conversion rate actually drops.Leading vs lagging indicatorsMid–senior You're launching a premium tier for a consumer app. What metrics tell you cannibalization of your base tier is healthy vs. problematic?What bad numbers would tell youSenior–leadership Your consulting project tracking tool shows high daily usage but low project completion rates. How would you segment users to understand who's getting value vs. who's just checking in?Segmentation strategyMid–senior If you had to pick two metrics for a referral program—one to optimize and one as a guardrail—what would they be and why isn't quality vs. quantity the right frame?Choosing primary vs guardrail metricsMid–senior Your investment research platform has power users reading 50+ reports monthly and casual users reading 2. Walk me through how you'd decide whether to build for the middle or double down on the extremes.Segmentation strategySenior–leadership What metrics would tell you that your API developer experience is degrading before developers actually start churning or complaining?Leading vs lagging indicatorsMid–senior Design a metrics framework for a biotech lab management system. What does success look like when your users are scientists and compliance is non-negotiable?Choosing primary vs guardrail metricsSenior–leadership Your search feature has a 45% null result rate but users keep searching. How would you segment search behavior to understand whether this is a problem or not?Segmentation strategyEntry–mid Walk me through the leading indicators you'd monitor to predict enterprise deal velocity is slowing before your sales pipeline metrics actually reflect it.Leading vs lagging indicatorsSenior–leadership You own the monthly close for a global company. What single primary metric would you run the close on, and what guardrails stop it from being gamed?Choosing primary vs guardrail metricsSenior–staff+Revenue is up 10% year over year, and DSO went from 45 to 68 days. What combinations of numbers would tell you this is a real problem rather than growth noise?What bad numbers would tell youMid–senior If you could track only two metrics to judge the earnings quality of a business unit, which would you pick and why?Leading vs lagging indicatorsMid–senior Consolidated gross margin missed plan by three points this month. Walk me through how you'd segment the variance to find out what actually happened.Segmentation strategyMid–senior You run a wealth management business. What's your one primary metric, and what guardrails go around it?Choosing primary vs guardrail metricsMid–senior Fund performance has been trailing peers for four quarters. Net outflows haven't started yet. What leading indicators of redemptions do you track, and why?Leading vs lagging indicatorsMid–senior Walk me through how you'd segment a fund's investor base to understand redemption risk.Segmentation strategySenior–staff+Your flagship fund beat its benchmark by 300 basis points this year. What specific result in the detail would worry you?What bad numbers would tell youSenior–staff+You own the operations dashboard for a fund administration business. Pick your primary operational health metric and the guardrails around it.Choosing primary vs guardrail metricsMid–senior