Stanford CS336 I Language Modeling from Scratch | Spring 2025 | Lecture 5: GPUs

Transcript

So hopefully everyone's having a good time with assignment one. It's due tonight. Let us know if you need an extension. Assignment two is coming out soon. We're putting on the finishing touches onto some of the Triton stuff. Hopefully, you'll enjoy it. You'll get to implement FlashAttention two or parts of FlashAttention two, which I think will be ... Read More