Stanford CS336 Language Modeling from Scratch | Spring 2025 | Lec. 2: Pytorch, Resource Accounting

Stanford CS336 Language Modeling from Scratch | Spring 2025 | Lec. 2: Pytorch, Resource Accounting
Transcript
OK, so last lecture, I gave an overview of language models and what it means to build them from scratch, and why we want to do that. I also talked about tokenization, which is going to be the first half of the first assignment. Today's lecture, we'll be going through actually building a model. We'll discuss the primitives in PyTorch that are needed... Read More
Install to Summarize YouTube Videos and Get Transcripts
Explore YouTube Video Summarizer or Get YouTube Transcript Extractor
Read in Other Languages (beta)
Share This Summary 📚
Summarize YouTube Videos and Get Video Transcripts with 1-Click
Download browser extensions on:
Try YouTube Summary with ChatGPT & Claude or YouTube Transcript Generator
Explore More Summaries from Stanford Online 📚

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 16 - Social & Ethical Considerations
Stanford Online

Bayesian Networks 4 - Probabilistic Inference | Stanford CS221: AI (Autumn 2021)
Stanford Online

Stanford Webinar - GPT-3 & Beyond
Stanford Online

Stanford CS229: Machine Learning | Summer 2019 | Lecture 20 - Variational Autoencoder
Stanford Online

Stanford AA228/CS238 Decision Making Under Uncertainty I Policy Gradient Estimation and Optimization
Stanford Online
Summarize YouTube Videos and Get Video Transcripts with 1-Click
Download browser extensions on:
Try YouTube Summary with ChatGPT & Claude or YouTube Transcript Generator