What Are P-Values and How Do You Interpret Them?

TL;DR

P-values indicate the likelihood that observed differences between two groups, such as drug A and drug B, are due to chance. A commonly used threshold for significance is 0.05; if the p-value is below this, we can confidently say there is a significant difference between the two drugs. However, a small p-value does not imply the size of the difference.

Transcript

gonna talk about p values yeah statquest hello i'm josh starmer and welcome to statquest today we're going to talk about what p-values are and how to interpret them imagine i have two drugs drug a and drug b and i want to know if drug a is different from drug b so i give one person drug a and i give one other person drug b the one person using drug... Read More

Key Insights

• 😀 P-values assess confidence in differences between treatments.
• ❓ A 0.05 threshold is commonly used for statistical significance.
• 🛩️ Small p-values indicate greater confidence in treatment disparities.
• ❓ Hypothesis testing evaluates if drugs have significant differences.
• 😀 Large sample sizes boost confidence in p-value results.
• 🛩️ False positives can occur with small p-values.
• 📈 Effect size and p-values are independent metrics in drug comparisons.

Questions & Answers

Q: What are p-values and how do they relate to drug comparisons?

P-values indicate the likelihood of seeing differences between drugs, helping establish statistical significance in comparisons.

Q: Why is a 0.05 threshold commonly used for p-values?

A 0.05 threshold ensures that only 5% of experiments would result in false positives when there is no real difference between drugs.

Q: Can p-values show how big the difference is between two drugs?

No, p-values only show if a difference exists, not the magnitude of that difference between drug treatments.

Q: What is the null hypothesis in the context of p-values?

The null hypothesis assumes no difference between drugs, and p-values help determine if this hypothesis should be rejected.

Summary & Key Takeaways

• P-values assess if differences between drugs are significant.

• A 0.05 threshold is commonly used for statistical significance.

• Small p-values indicate confidence in drug differences.