The Hierarchy of Marketplaces: Prioritizing User Happiness and Effective Metrics

The Hierarchy of Marketplaces: Prioritizing User Happiness and Effective Metrics

Introduction:
When it comes to building successful marketplaces, the key factor lies in making both buyers and sellers genuinely happy. The pursuit of growth should not be the ultimate goal; instead, it should be seen as a means to increase the average level of happiness per transaction. This article explores the hierarchy of marketplaces, emphasizes the importance of user happiness as a moat, and discusses the limitations of using Net Promoter Score (NPS) as a sole metric for product quality.

Level 1: User Happiness and Market Prioritization:
In the world of marketplaces, the winning platform is the one that can make its users happier than any alternative. Gross Merchandise Value (GMV) is often seen as a vanity metric that can mislead businesses if solely pursued. Instead, the focus should be on creating enduring value and prioritizing quality growth over quantity.

One effective way to ensure user happiness is by analyzing the retention rate of specific cohorts within the marketplace. By identifying the segments that retain the best, businesses can double-down on those particular use cases or markets. This approach helps in avoiding the common mistake of going after too large a market without a clear focus.

Level 2: Net Revenue Retention and Alternative Metrics:
While GMV may not accurately reflect the true value being created, "net revenue retention" can serve as a reliable measure of user happiness. Although not perfect, it provides insights into customer satisfaction and overall marketplace performance. Net Promoter Score (NPS), on the other hand, has its limitations and is often viewed as a numerical representation of qualitative data.

NPS surveys can be directional and offer some guidance, but they do not present a complete story. Organizations may place too much emphasis on NPS as a single source of truth, mistaking it for a quantitative metric when it is, in fact, based on qualitative data. To capture a more comprehensive understanding of customers, surveys should encompass various factors such as demographics, competitive product usage, and entertainment preferences.

Level 3: The Importance of Proxy Metrics and Contextual Analysis:
When it comes to assessing product quality, monthly customer retention proves to be a more accurate proxy metric than NPS. It measures customer behavior rather than their expressed opinions. For instance, Netflix found that the percentage of members canceling each month provided a clearer indication of product quality than NPS.

Contextual analysis is crucial in interpreting NPS scores accurately. Cultural differences can significantly impact how customers rate a service or product. For example, Netflix experienced high NPS scores in South America but struggled with retention initially. It was later discovered that Brazilians were more generous with their ratings compared to customers in Australia and Germany.

Actionable Advice:

1. Prioritize User Happiness: Focus on making buyers and sellers genuinely happy, rather than solely pursuing growth metrics like GMV. Understand which market segments retain best and double-down on those areas.

2. Use Multiple Metrics: While NPS can serve as a directional tool, it should not be the sole metric for measuring product quality. Consider using proxy metrics like monthly customer retention to gain a more accurate understanding of user satisfaction.

3. Contextualize NPS Scores: Take cultural and regional differences into account when interpreting NPS scores. Recognize that NPS is a numerical representation of qualitative data and should be complemented by other surveys and data sources.

Conclusion:
In the hierarchy of marketplaces, true success lies in ensuring user happiness and creating enduring value. While NPS surveys can provide some insights, they should not be relied upon as the sole indicator of product quality. By prioritizing user happiness, utilizing multiple metrics, and contextualizing data, businesses can build stronger marketplaces that stand the test of time.