#21 Machine Learning Engineering for Production (MLOps) Specialization [Course 1, Week 2, Lesson 13]

TL;DR

Data augmentation can change the distribution of training data but usually doesn't hurt performance, unless the model is small or the mapping from input to output is unclear.

Transcript

for a lot of machine learning problems the training sets and depth and test set distribution start up being reasonably similar but if you're using data augmentation you're adding to specific parts of the training set such as adding lots of data with cafe noise so now your training set may come from a very different distribution than the deaf set an... Read More

Key Insights

• 😫 Training set and test set distributions can differ due to data augmentation, but it usually doesn't harm performance in unstructured data problems.
• 🔡 Large models with low bias can handle changes in input data distribution caused by data augmentation without a significant drop in performance.
• 🏷️ Adding accurately labeled data through data augmentation improves accuracy unless the mapping from input to output is unclear, such as distinguishing between similar characters.

Questions & Answers

Q: Can data augmentation hurt the performance of machine learning algorithms?

Data augmentation typically does not hurt performance, unless the model is small or the mapping from input to output is unclear. In most cases, adding accurately labeled data improves accuracy, even if it changes the input data distribution.

Q: What is an example of when adding more data could hurt performance?

An example is distinguishing between the number "1" and the letter "i" in house numbers. If the training set is skewed with more "i" examples, it may cause the algorithm to incorrectly classify ambiguous cases as "i" instead of "1", reducing performance.

Q: Why doesn't data augmentation usually hurt performance?

It doesn't hurt performance because, for unstructured problems, adding labeled data rarely affects accuracy. As long as the model is large enough and the mapping from input to output is clear, it can handle variations in the input data distribution.

Q: How does data augmentation impact structured data problems?

In structured data problems, different techniques are useful. The video suggests exploring these techniques in the next video, indicating that data augmentation may have different implications in structured data scenarios.

Summary & Key Takeaways

• Data augmentation can alter the distribution of training data, but this typically does not affect the performance of machine learning algorithms, as long as the model is large and the mapping from input to output is clear.

• Adding accurately labeled data through data augmentation rarely decreases accuracy, even if it significantly alters the input data distribution.

• However, if the model is small, changes in input data distribution may cause it to focus too much on specific patterns, hurting its performance on other types of data.