The Only Metric That Matters: User Engagement and Core Actions

The Only Metric That Matters: User Engagement and Core Actions

In the world of product development, there is a fundamental question that every founder needs to ask themselves: Are people using your product? This question may seem simple, but it holds the key to determining the success and viability of any product or service. Josh Elman, in his article "The Only Metric That Matters," highlights the importance of user engagement and performing core actions as the ultimate measure of a product's value.

Elman suggests that founders should focus on three key aspects when evaluating user engagement: usage, core actions, and frequency. The first aspect, usage, refers to whether people are actually using the product. This metric goes beyond mere sign-ups or downloads and delves into whether users are actively engaging with the product on a regular basis.

The second aspect, core actions, is perhaps the most crucial. It pertains to whether users are performing the intended actions that define the product's purpose. For example, in a social media app, the core action might be posting, liking, or commenting on content. By analyzing whether users are consistently performing these core actions, founders can gain valuable insights into the product's effectiveness and appeal.

Lastly, frequency measures how often users are performing the core actions. This metric helps determine the level of user engagement and whether the product has successfully ingrained itself into users' routines. If users are only sporadically engaging with the product, it may indicate a lack of value or relevance.

Elman's framework of dividing the user base into three buckets - cold, casual, and core - is a useful way to understand the varying levels of engagement. Cold users are those who do not return to the product after initial interaction, indicating a lack of interest or dissatisfaction. Casual users may sporadically engage with the product but are not fully committed. Core users, on the other hand, are highly likely to keep coming back and actively perform the core actions. These users are the lifeblood of any successful product.

While Elman's article focuses on user engagement, another interesting perspective on the topic comes from the world of chatbots. ChatGPT, touted as the world's best chatbot, offers a unique insight into the concept of user engagement. Unlike traditional search engines, ChatGPT is not bound by rigid algorithms and can provide flexible and conversational responses. It has the ability to generate information rather than simply retrieve it.

However, this flexibility comes with a caveat. ChatGPT's objective is not to be factual or truthful, which means it can make up information just as easily as it can provide accurate answers. This raises an important distinction between search engines and language models like ChatGPT. Search engines retrieve information from the internet and present a list of links, while language models generate responses based on their training data. Although search engines may occasionally display fake news, their reliance on external sources makes them generally more reliable than language models.

The key takeaway here is that user engagement is multifaceted. It encompasses not only the usage and frequency of interactions but also the quality and reliability of the information or responses provided. In the case of language models, the burden falls on the user to verify the accuracy of the generated content.

It is worth noting that the limitations of language models like GPT-3 are not necessarily a failure on their part. Rather, it is often our inability to provide adequate prompts or set the right parameters that hinder their performance. By understanding the capabilities and limitations of these models, we can better harness their potential and leverage them as valuable tools.

In conclusion, user engagement and performing core actions are the ultimate metrics that determine a product's success. Founders should focus on analyzing usage, core actions, and frequency to gain insights into user behavior and product effectiveness. Additionally, it is important to consider the quality and reliability of information provided, especially in the context of language models like ChatGPT. By understanding these concepts and incorporating actionable advice, founders can drive user engagement and propel their products towards success.

Actionable Advice:

1. Regularly analyze user engagement metrics to assess the health and effectiveness of your product. Pay attention to usage, core actions, and frequency to identify areas for improvement.
2. Continuously iterate and optimize your product to align with user expectations and needs. Actively seek feedback from users to understand their pain points and address them accordingly.
3. Balance flexibility and reliability when utilizing language models or chatbots. While they offer conversational capabilities, always verify the accuracy and credibility of the information provided before making decisions based on it.