Summaries of Andrej Karpathy Videos 📚

Building makemore Part 3: Activations & Gradients, BatchNorm

The spelled-out intro to language modeling: building makemore

Let's build the GPT Tokenizer

[1hr Talk] Intro to Large Language Models

Building makemore Part 2: MLP

Building makemore Part 5: Building a WaveNet

The spelled-out intro to neural networks and backpropagation: building micrograd

Let's build GPT: from scratch, in code, spelled out.

Let's reproduce GPT-2 (124M)

Building makemore Part 4: Becoming a Backprop Ninja