A16Z built a super-efficient AI GPU server from scratch with RTX 4090s

Server specifications:<p>- Server model: ASUS ESC8000A-E12P - GPUs: 8x NVIDIA RTX 4090 - CPU: 2x AMD EPYC 9254 Processor (24-core, 2.90GHz, 128MB Cache) - RAM: 24x 16GB PC5-38400 4800MHz DDR5 ECC RDIMM (384GB total) - Storage: 1.92TB Micron 7450 PRO Series M.2 PCIe 4.0 x4 NVMe SSD (110mm) - Operating system: Ubuntu Linux 22.04 LTS Server Edition (64-bit) - Networking: 2 x 10GbE LAN ports (RJ45, X710-AT2), one utilized at 10Gb - Additional PCIe 5.0 card: ASUS 90SC0M60-M0XBN0