The Dangers of Vanity Metrics and the Benefits of Being a 'Regular' at Your Favorite Spots

The Dangers of Vanity Metrics and the Benefits of Being a 'Regular' at Your Favorite Spots

In the business world, metrics are crucial for measuring success and making informed decisions. However, not all metrics are created equal. Some metrics, known as vanity metrics, can be misleading and even dangerous. Vanity metrics are numbers that make you look good but have no material impact on your ability to make good decisions and improve your business. They are superficial and fail to drive durable revenue growth.

So, what makes a good metric? A good metric is one that's easy for everyone to understand and track. It should allow us to compare things over periods of time to see trends. Taking a comparative number and turning it into a ratio or rate can make it even more valuable. Most importantly, a good metric is one that you use to make decisions.

Now let's delve into some specific examples of vanity metrics and why they can be problematic.

1. Daily and Monthly Active Users
   Having a large number of active users may seem impressive, but it's important to consider whether these users are actually performing actions linked to the core value of your product or service. A high number of active users is meaningless if they are not engaged and driving revenue.

2. Net Churn
   Net churn refers to the number of customers lost over a specific period. It's crucial to accurately track customer churn to identify any underlying problems with client acquisition. If you can't tell exactly how many gross customers are dropping out, you may be masking a larger problem through your client acquisition pace.

3. Cumulative Metrics
   Cumulative metrics can give the illusion of progress, but they may not provide a clear picture of the current state of your business. It's important to analyze metrics on a regular basis to understand trends and identify areas that need improvement.

4. Funding Raised
   While raising funds can provide an opportunity to run more experiments and learn from them, it can also lead to spending on things that are not essential for your business. Money can buy you time, but it can't buy you execution. It's crucial to prioritize spending and invest in areas that will drive sustainable growth.

5. ESG Scores
   Environmental and Social Good (ESG) scores are often used as a measure of a company's impact on the environment and society. However, these scores can be misleading and may not accurately reflect a company's true sustainability efforts. It's important to dig deeper and understand the methodology behind ESG scores before making any judgments.

6. GitHub Stars
   For Open Source companies, GitHub stars are often seen as a measure of popularity and success. However, relying solely on GitHub stars as a metric can be misleading. It's important to consider other factors such as community engagement, active contributors, and the actual impact of the software.

7. Net Dollar Retention above a certain threshold
   Net Dollar Retention (NDR) is a metric that measures the revenue retained from existing customers over a specific period. While a high NDR may seem impressive, it's important to consider the customer segments being included in this metric. Many companies will group customers by size, which can skew the NDR. It's crucial to consider survivorship bias and ensure that the metric is truly reflective of your customer base.

8. Any metric void of segmentation
   Metrics are only useful if they can be applied to run the business effectively. If you don't segment your metrics, you will never truly utilize them. Understanding how long it takes to recoup your Customer Acquisition Cost across different market segments is essential for making informed decisions and driving growth.

9. Customer Lifetime Value (LTV)
   LTV is a metric that measures the revenue generated over the lifetime of a customer. However, it's important to consider the track record of your customers before calculating LTV. A track record of less than three years may not provide an accurate reflection of your customer's value. It's crucial to rely on assumptions and consider longer-term trends.

10. Headcount
    Headcount is often used as a measure of a company's size and growth. However, headcount on its own is just a reflection of cost without any context to productivity. It's important to consider the productivity of your workforce and ensure that your headcount is aligned with your business goals.

11. Net Promoter Score (NPS)
    NPS is a metric that measures customer loyalty and satisfaction. However, it's important to be cautious when interpreting NPS. Some companies may manipulate NPS by taking biased reviews into account. It's crucial to consider the source and methodology behind NPS calculations.

12. Adjusted EBITDA
    EBITDA is a commonly used metric to measure a company's profitability. However, it's important to dig into the assumptions behind adjusted EBITDA to ensure that it's a clean and accurate representation of your business's financial health.

13. Like for Like Revenue
    Like for Like (LFL) revenue is a metric that compares revenue from comparable periods to identify organic growth. However, it's important to neutralize LFL revenue for inflation and foreign exchange impacts. Revenue is influenced by both price and volume, and it's essential to consider the impact of these factors on your LFL revenue.

While vanity metrics can be alluring, it's important to focus on metrics that truly drive success and improve decision-making. Here are three actionable pieces of advice to help you navigate the world of metrics:

1. Prioritize metrics that have a direct impact on revenue growth and customer satisfaction. Focus on metrics that align with your business goals and provide actionable insights.

2. Segment your metrics to gain a deeper understanding of different market segments and customer behaviors. This will help you make informed decisions and allocate resources effectively.

3. Regularly review and analyze your metrics to identify trends and areas for improvement. Don't rely solely on cumulative metrics or vanity metrics that may mask underlying issues.

In conclusion, vanity metrics can be dangerous and misleading. It's crucial to prioritize metrics that provide valuable insights and drive sustainable growth. By focusing on meaningful metrics and regularly reviewing and analyzing them, you can make informed decisions and improve your business's performance.