This Laptop Runs LLMs Better Than Most Desktops

Transcript

How is this possible? This 110 billion parameter model, Quen 110 billion is running on this machine. But even my 5090 can't run this model. I'll tell you how. This little device has 128 GB of unified memory on board. Oh, unified memory, you say? Is that kind of like Apple's unified memory in this M4 Max? Not exactly. And this does affect LLM perfor... Read More