Vanity metrics
Vanity metrics are measurements that feel good to report but don't actually inform decisions or predict business outcomes. They go up and to the right on charts, they impress in board meetings, and they're utterly useless for understanding whether your product is actually succeeding. Total registered users, page views, app downloads, and social media followers are classic examples - numbers that grow over time regardless of whether your product is healthy.
Why they're dangerous
Vanity metrics don't just fail to help - they actively harm decision-making in several ways.
They create false confidence. When impressive-looking numbers go up, teams assume they're succeeding. This masks underlying problems until they become crises. A product might accumulate millions of registered users while actual usage collapses.
They misdirect effort. Teams optimize for the metrics they're measured on. If you celebrate total downloads, teams will find ways to increase downloads - including dark patterns, misleading ads, and incentivized installs that attract users who never engage.
They delay hard conversations. As long as vanity metrics look good, difficult questions about product-market fit, retention problems, or unsustainable unit economics get postponed. The reckoning comes eventually, but later and more painfully.
They consume attention. Time spent tracking, analyzing, and presenting vanity metrics is time not spent on meaningful analysis. Dashboards filled with useless numbers crowd out the few metrics that actually matter.
Identifying vanity metrics
A metric is likely a vanity metric if:
It only goes up. Cumulative metrics like "total users ever" can never decrease. A metric that can't decline can't tell you when things go wrong.
It's not actionable. If the number changed significantly tomorrow, would you know what to do differently? If not, why are you tracking it?
It doesn't connect to value. Does this metric correlate with customer success or business outcomes? Page views mean nothing if visitors aren't finding value.
It's easily gamed. If you can inflate the metric without improving the product, it's vulnerable to Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure."
It lacks context. Raw numbers without comparison points are meaningless. One million users sounds impressive until you learn your market has 500 million potential users and your competitor has 100 million.
Vanity metrics vs. actionable metrics
The opposite of vanity metrics are actionable metrics - measurements that inform specific decisions and connect to business outcomes.
| Vanity Metric | Actionable Alternative |
|---|---|
| Total registered users | Monthly active users |
| Page views | Engagement rate |
| App downloads | Activation rate |
| Total revenue (cumulative) | Monthly recurring revenue |
| Social media followers | Engagement rate, referral traffic |
| Email list size | Open rate, click-through rate |
| Features shipped | Feature adoption rate |
The pattern is clear: actionable metrics measure behavior and engagement, not mere presence or accumulation.
The role of context
Some metrics are vanity in some contexts and valuable in others. Total registered users is vanity if it's your primary success metric, but useful as context for calculating activation rates. Page views are meaningless alone but informative when analyzed by source, intent, or conversion.
The problem isn't specific metrics but how they're used. Any metric becomes vanity when it's treated as an end in itself rather than a means to understanding.
Why teams fall into the trap
Despite widespread awareness, vanity metrics persist because they serve psychological and organizational needs:
They feel good. Watching big numbers get bigger is satisfying. No one enjoys presenting metrics that reveal problems.
They're easy to get. Vanity metrics are often default analytics outputs. Meaningful metrics require intentional tracking and more sophisticated analysis.
They impress stakeholders. Investors, executives, and board members often don't know which metrics matter. Big numbers create impressions of momentum.
They avoid accountability. Vanity metrics let teams appear successful without demonstrating actual impact. Real metrics invite harder questions.
Building a better metrics practice
Escaping vanity metrics requires intentional design of what you measure and how you use it.
Start with decisions. What decisions do you need to make? What information would help you make them better? Work backward from decisions to metrics.
Focus on behavior. Measure what users do, not just what they are. Registration is an event; regular usage is a behavior. Behaviors predict outcomes.
Use cohort analysis. Compare users who joined at different times. This reveals trends that cumulative metrics hide. If your September cohort retains better than your June cohort, you've improved something - cumulative metrics would never show this.
Set benchmarks. Numbers need context. Is 5% retention good or bad? Compare to industry benchmarks, historical performance, or cohort trends.
Limit dashboard metrics. If you track everything, you focus on nothing. A small set of carefully chosen metrics drives more action than comprehensive dashboards no one reviews.
The organizational challenge
Eliminating vanity metrics often means telling stakeholders that the numbers they've been celebrating are meaningless. This is politically difficult but necessary. Start by adding actionable metrics alongside vanity metrics, demonstrate their predictive power, then gradually shift focus.
Tools like Klero help by connecting product metrics to actual customer feedback. When you can see not just that users churned but why they churned - in their own words - you move from vanity to understanding. The numbers start telling stories that inform action.
