How to Build a Custom Multi-GPU AI PC From Scratch

TL;DR

Building a multi-GPU compute rig means abandoning off-the-shelf cases entirely. After a mini ITX build blocked a GPU swap, the fix was an open-air frame made from aluminum extrusions, with hand-tapped screw holes, a custom PSU mount, and a homemade GPU bracket that alternates cards up and down so each one can breathe. Expect wrong-size screws, repeated redesigns, and an electrician visit.

Transcript

A few months ago, I built my very first gaming PC. Felix, it started a whole journey of me installing Linux, writing my very first line of code, completely deging, running my own self-host. But there's one truth that I can't escape. In order to successfully ascend, I need more compute. The less I touch grass, the more I touch the clouds. That's rig... Read More

Key Insights

• Aluminum extrusions are a practical DIY case material because they are strong, lightweight, and relatively cheap, and because parts can be loosened and slid anywhere along the rail, so a bracket that does not fit can be repositioned instead of replaced.
• Off-the-shelf cases fail multi-GPU builds because a millimeter of difference makes parts incompatible. After swapping the GPU in an earlier mini ITX build, the case no longer fit, which is what pushed the move to an open-air frame.
• Stacking GPUs directly against each other is a thermal mistake. The chosen layout alternates one card down, one up, one down, one up, so each card has open space around it to pull air rather than sharing a sealed sandwich of hot metal.
• Tapping your own screw holes into metal extrusion demands more precision than a first-timer has. The first attempt failed to line up the motherboard, so a different mounting method with cutting lubricant was used instead, repeated across many holes.
• The economic case for local hardware over cloud rental is framed as compute rate times number of GPUs times hours per day over months, until the rig has covered what would have gone to cloud bills. The stated non-cost benefits are full privacy and no throttling.
• Sourcing GPUs was harder than expected because prices were high everywhere, not just in Japan. Travel to Sweden and Italy showed the same problem, and a market-scanning script written to find deals got blocked by anti-bot measures.
• Power draw became a real constraint rather than a spec-sheet line. An electrician was called in, the verdict was bad, and solar is the planned answer since the household wiring cannot support what the machine wants to pull.
• Iteration is the normal cost of a custom build, not a sign of failure. The layout was rebuilt through several versions as better arrangements were found, with each round adding work but improving airflow and mounting.

Questions & Answers

Q: Why build a custom PC case instead of buying one?

Off-the-shelf cases lock you into exact dimensions. In the earlier mini ITX build, a millimeter of difference made parts incompatible, and after a GPU swap the case simply no longer fit the hardware. A build with several GPUs plus two power supplies has no standard enclosure that accommodates it comfortably. Building the case yourself gives full freedom over layout, spacing between cards, and where the power supplies sit, and it means a later hardware change does not force buying a whole new chassis.

Q: What material is best for a DIY open-air PC case?

Aluminum extrusion in the 3030 size was chosen for this build. The reasons given are that it is strong, lightweight, and relatively cheap, and it was available from a local Japanese company rather than requiring a long international shipping wait. The other advantage that emerged during the build is adjustability: once you get the hang of working with aluminum, brackets and mounts can be loosened and slid to new positions, so a layout can be reworked repeatedly without cutting new material every time.

Q: How should you arrange multiple GPUs for cooling?

Do not pack them together. Putting all the cards flush against each other is described as a giant GPU cheeseburger and a terrible idea, because the inner cards have no path to draw fresh air. The layout used instead alternates the cards: one down, one up, one down, one up, so each card has clearance around it to breathe. An open-air case supports this by removing the enclosure restriction entirely, at the cost of collecting dust over time.

Q: Is a local GPU rig cheaper than renting cloud compute?

The argument made is that it can be, framed as a rate per GPU multiplied by the number of GPUs, multiplied by hours of use per day, over a period of months, at which point the hardware has covered what the equivalent cloud spend would have been. The pitch is delivered half as a joke to justify the purchase. The non-financial reasons given are more concrete: full privacy over your own data, no risk of being throttled, and no account bans over how you use the machine.

Q: Why are GPU prices so hard to work around right now?

The problem is not regional. Prices were checked in Japan and also during travel to Sweden and Italy, and the conclusion was that every market was bad, not just one. There were also so many variables involved in comparing listings that manual research became overwhelming. An automated script was written to scan the market for options, but it returned strings of meaningless URLs, which turned out to be anti-bot measures, meaning the scraper itself had become the problem it was trying to solve.

Q: What problems come up when tapping your own screw holes in aluminum extrusion?

Tapping means cutting threads into metal that has no holes yet, and the first attempt failed because mounting a motherboard requires the holes to line up with tight precision that a first-timer does not have. The fix was switching methods and using cutting lubricant so the tap moved through the metal smoothly, then repeating that operation across a very large number of holes. It is slow, repetitive work, and getting it wrong means the board will not sit flat.

Q: What unexpected problems delay a custom PC build the most?

Small parts mismatches, not the big engineering decisions. The recurring blockers were screws in the wrong size, standoffs that did not match the available screws, GPU brackets purchased that did not fit at all and had to be fabricated by hand, PSU holders that were unavailable without an extremely long shipping wait to Japan, and an electrical socket that did not match the plugs. Each of these individually cost about a day, since the motherboard could not go in until the mounting was resolved.

Q: How do you handle the power requirements of a multi-GPU workstation?

Power draw was serious enough to require calling an electrician, whose assessment was that the existing supply was not going to work. Two power supplies are used in the build, and their combined draw is compared to the consumption of an average Japanese household. The plan going forward is to go solar to generate the additional power needed. Physical mounting also had to account for local conditions: the power supplies are strapped down so they stay in place during an earthquake.

Summary & Key Takeaways

• The build follows a first gaming PC that led into Linux, coding, and self-hosting, with the new machine framed as a step up in raw compute. Core parts include a large motherboard, an AMD Threadripper CPU, two power supplies, RAM described as only half of what is wanted, and multiple RTX 4000 cards with 20 GB of VRAM each.

• GPU sourcing was the hardest part of the parts list. Prices were unreasonable in every market checked, including during trips to Sweden and Italy, so the choice landed on unexciting cards that become interesting mainly because several run together. A script written to scan listings returned gibberish URLs, which turned out to be anti-bot defenses.

• The case is built from scratch out of 3030 aluminum extrusions bought from a local Japanese company. The frame went together quickly, but tapping screw holes, mounting the power supplies with repurposed fan brackets, fabricating a GPU bracket, sawing pieces to length, and fighting wrong-size screws and mismatched plugs stretched the project across many days and several full redesigns.