Stanford CS336 Language Modeling from Scratch | Spring 2025 | Lecture 14: Data 2

Transcript

So this is the second lecture on data. In the last lecture, we talked about different data sets that were used to train various language models. We did a historical overview from the data sets that were used to train BERT to all the way up to HOMO and everything in between. And one of the things I wanted to emphasize is that data doesn't just fall ... Read More