Defining Metrics Other Techniques

TL;DR

Learn about different techniques for generating new metric ideas and validating metrics using external data, surveys, and academic research.

Transcript

We've just seen some examples of metrics that are difficult to measure directly or even impossible. You said, there are some other techniques we can use here, right? >> Right. And these techniques are actually useful for generating new ideas for metrics, as well. And so they're useful for both the new ideas, as well as digging deeper into a user... Read More

Key Insights

• 👥 Techniques like surveys, retrospective analyses, and focus groups aid in brainstorming new metric ideas and understanding user experiences.
• 📈 External data from companies like comScore and Nielsen can validate metrics by comparing them to industry benchmarks.
• 👨‍🔬 Academic research papers offer insights and data for supporting or validating metrics.
• 👶 These techniques are valuable for generating new ideas, validating metrics, and developing validation techniques.

Questions & Answers

Q: What are some techniques that can be used to generate new metric ideas?

Techniques such as surveys, retrospective analyses, and focus groups can be helpful for brainstorming new metric ideas. Surveys can gather user data on topics such as device usage and time spent on certain activities, while retrospective analyses and focus groups can provide insights into user experiences and behaviors.

Q: How can external data be used to define and validate metrics?

Companies like comScore and Nielsen collect granular data on market share verticals and specific websites. This data can be used to define and validate metrics by comparing your own metrics to industry benchmarks. If your metrics are significantly different, it may indicate a need for adjustments or further validation.

Q: How can academic research papers be utilized in the context of metrics?

Academic research papers often establish and validate metrics through correlation studies and experiments. These papers can provide valuable insights and data that can be used to support or validate your own metrics. By analyzing their research methodologies, you can develop validation techniques for your metrics.

Q: What are the benefits of using these techniques for metrics?

These techniques have multiple benefits. They help in generating new metric ideas, validating existing metrics through industry benchmarking, and developing validation techniques based on established research methodologies. They provide a broader perspective and deeper understanding of user experiences beyond what existing metrics can reveal.

Key Insights:

• Techniques like surveys, retrospective analyses, and focus groups aid in brainstorming new metric ideas and understanding user experiences.
• External data from companies like comScore and Nielsen can validate metrics by comparing them to industry benchmarks.
• Academic research papers offer insights and data for supporting or validating metrics.
• These techniques are valuable for generating new ideas, validating metrics, and developing validation techniques.
• They provide a broader understanding of user experiences and help in improving tracking and analysis of metrics.

Summary & Key Takeaways

• Techniques such as surveys, retrospective analyses, and focus groups can be used to brainstorm new metric ideas and validate possible metrics.

• External data from companies like comScore and Nielsen, as well as surveys conducted by companies like Pew and Forrester, can provide valuable information for defining and validating metrics.

• Academic research papers can also be a source of metrics or similar data that can be used for brainstorming, validating, and developing techniques for metric validation.