AI's Memory Wall: Why Compute Grew 60,000x But Memory Only 100x (PLUS My 8 Principles to Fix)

Transcript

Memory is perhaps the biggest unsolved problem in AI and it is one of the only problems in AI that is getting worse, not better. As we get better and better and better at intelligence, we get worse at memory, relatively speaking. In fact, there's a name for it in the model maker community. It's called the memory wall. We are not improving the hardw... Read More