Stanford CS336 Language Modeling from Scratch | Spring 2025 | Lecture 15: Alignment - SFT/RLHF

Transcript

OK, so we'll get started. Welcome to lecture 15. We've got two pieces left to the class. And that's going to be various aspects of post-training. Up until now, we've focused very much on the big pre-training systems data components. And then now, we're going to take the big pre-trained model, and we're going to make it useful and safe in various wa... Read More