Why Is User Research Facing a Reckoning Now?

TL;DR

User research creates more business value when it helps teams falsify assumptions, shape strategy, and improve product quality, rather than merely confirming decisions already made. Researchers and product partners should prioritize macro and micro questions, connect user needs to business success, and involve research early enough to change decisions instead of using late studies as symbolic validation.

Transcript

User-centered performance refers to customer  obsession or user-centered practice that is symbolic rather than focused on learning. It's  hugely common, I would argue. It's work we do to signal to each other how customer obsessed we are,  not because we want to make a different decision.   If your listeners are like, "I don't do that."  I'm like, "... Read More

Key Insights

• User research is facing a reckoning because research teams were hit particularly hard by layoffs, suggesting that the discipline may not be delivering, demonstrating, or receiving recognition for the business value and organizational impact it could provide.
• Macro research is strategic, forward-looking work that examines markets, competitors, innovation, long-term opportunities, and where a product should go next. Its purpose is to connect user understanding with consequential choices about business and product direction.
• Micro research is focused work that supports high-quality execution, including technical usability studies, detailed product refinement, and investigation of A/B test results. It helps teams improve the specific experience they are preparing to deliver.
• Middle-range research is centered on understanding how selected groups think, feel, behave, or use a product. Antin argues that this work can be genuinely interesting while remaining insufficiently connected to decisions that materially affect the business.
• User-centered performance is symbolic customer obsession conducted to signal that a team cares about users, not to learn something that could change its course. It commonly appears when research is requested after the important product decisions have already been made.
• Research should falsify assumptions rather than merely validate them. A useful study actively searches for evidence that a team might be wrong, while validation-oriented requests can become exercises in confirming what product managers or designers already want to believe.
• Researchers need to focus more directly on business success because their role within a company is to help the organization succeed. Antin identifies resistance to profit and growth considerations as one of the notable critiques of his argument.
• Research quality depends on organizational integration as well as researcher performance. Antin does not place responsibility solely on researchers, because companies often position them poorly and repeatedly ask them to answer middle-altitude questions with limited influence on important decisions.

Questions & Answers

Q: Why is user research facing a reckoning?

User research is facing a reckoning because research and other UX roles were hit particularly hard by layoffs, prompting questions about whether the discipline is creating and demonstrating enough business impact. Judd Antin argues that the system may be more broken than many assume. The problem includes both the work researchers perform and how companies integrate, position, and use research.

Q: What are the three types of user research?

The three types are macro, middle-range, and micro research. Macro research addresses strategic questions about markets, competitors, innovation, long-term opportunities, and product direction. Micro research supports detailed usability, product quality, and interpretation of A/B test results. Middle-range research examines how groups think, feel, behave, or use products, but may not influence sufficiently important business decisions.

Q: What is macro user research used for?

Macro user research is used for big-picture, strategic, business-focused, and forward-looking decisions. It can examine the market, competitors, future innovation, and where a product should go next. Its value comes from influencing consequential choices about long-term product and business direction, rather than focusing only on a narrow feature or a late-stage product decision.

Q: What is micro user research used for?

Micro user research is used to improve the detailed quality of a product that is moving toward release. It includes technical usability work, focused investigation of A/B test results, and research that supports a refined, high-quality experience. This work is narrow in scope, but it can directly enable teams to improve specific elements of the product they are building.

Q: Why can middle-range user research have limited impact?

Middle-range research can have limited impact because it often explores broad user-understanding questions without a strong connection to major strategic choices or detailed execution decisions. Studying how a group thinks, feels, behaves, or uses a product may be interesting to researchers and colleagues, yet the findings may not be consequential enough to change business outcomes or product direction.

Q: What is user-centered performance in product development?

User-centered performance is customer obsession or user-centered practice performed mainly as a symbol. Teams use it to show one another that they care about users, even though they are not seeking information that could alter a decision. A typical example is requesting a quick study near the end of development, when the team already intends to ship the product.

Q: Why should research falsify rather than validate assumptions?

Research should falsify assumptions because its purpose is to discover where a team may be wrong, not simply confirm what product managers or designers already believe. Validation requests can encourage researchers to check a procedural box after decisions are settled. Falsification creates a more genuine learning posture by making contradictory evidence valuable and allowing findings to redirect the team.

Q: How can companies use user researchers more effectively?

Companies can use researchers more effectively by involving them early enough to affect decisions, connecting their work to business goals, and selecting questions with clear strategic or execution value. Teams should avoid treating research as late-stage validation. They should also improve how research is positioned and integrated, since limited impact is not solely the responsibility of individual researchers.

Summary & Key Takeaways

• Judd Antin argues that the user research discipline is facing a reckoning because layoffs may signal deeper problems with its organizational position and business impact. The field can still thrive, but researchers and companies must reconsider which questions they study, how research is integrated, and whether findings can change decisions.

• Antin divides research into macro, middle-range, and micro work. Macro research examines markets, competitors, innovation, long-term direction, and business strategy. Micro research improves detailed product quality and interprets experiments. Middle-range research explores how groups think, feel, behave, or use products, but can produce interesting findings without sufficient business impact.

• User-centered performance occurs when teams conduct research mainly to demonstrate customer obsession rather than learn or reconsider a decision. A late request to validate assumptions often arrives after shipping is effectively inevitable. Antin recommends seeking evidence that could falsify assumptions and involving researchers early enough to influence product direction and business outcomes.