Build a private, self-hosted LLM server with Proxmox, PCle passthrough, Ollama, Open WebUI & NixOS

Transcript

Self-hosted, offline, fully privacy-respecting AI. That's something I'm super-duper excited about at the moment, and that's the topic for today's video. Self-hosted local AI puts you in control of your own data, and once you've purchased the hardware to run it, that's it, no ongoing subscriptions. So if you've been concerned about sending your sens... Read More