Stanford CS231N | Spring 2025 | Lecture 11: Large Scale Distributed Training

Transcript

Welcome back to CS231n lecture 11. Today, we're going to talk about large-scale distributed training. And this is a pretty exciting topic, because this is basically how all neural networks get trained in practice today. When you look at large models from startups, from industries, even in academia, really large-scale is the new norm in deep learnin... Read More