Cheap mini runs a 70B LLM 🤯

Transcript

a little while ago Rah a member of the channel sent me this post this person wayu wrote a blog post about running llama 70 billion parameter inference on an Intel Core Ultra 5 a pretty decent processor Ultra efficient and therefore they can shove it into a little mini PC but what he did was replace the ram that it comes with it comes with 32 gigs o... Read More