Newest Gen AI Servers Are Built Like This

We check out the new NVIDIA B300 solutions from Supermicro and compare them to the NVIDIA B200 generation. We also get into the Spectrum-X networking, liquid cooling, and much more that go into building an AI factory. STH Main Site Article: https://www.servethehome.com/checking-out-the-supermicro-nvidia-b300-solutions-and-what-it-takes-to-build-an-ai-factory/ Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ ---------------------------------------------------------------------- Where to Find The Unit We Purchased Note we may earn a small commission if you use these links to purchase a product through them. ---------------------------------------------------------------------- STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - Touring a 100,000 GPU Cluster at xAI Colossus: https://youtu.be/Jf8EPSBZU7Y - Touring Lambda AI Cluster at Cologix: https://youtu.be/N5AJJ0tAoxc - Touring a 25 Year Old and a New Data Center: https://youtu.be/dmUmx3c8eJs - A fun data center tour: https://youtu.be/qUmLnSEVVDw - 2025 AI PCIe GPU Guide: https://youtu.be/SEaebgjKbCc - Inside the NVIDIA H200 AI Server: https://youtu.be/dmOCYFVLi2M - Modern AI server power: https://youtu.be/iUvCpxad0Vs ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 00:24 Main Server Types in an AI Factory 01:24 Air-cooled Supermicro NVIDIA B300 vs. B200 Platforms 02:27 Liquid-cooled Supermicro NVIDIA B300 vs. B200 Platforms 04:47 Supermicro 2OU 8-GPU NVIDIA B300 Platform with NVIDIA Quantum-X800 06:30 Supermicro NVIDIA RTX Pro 6000 Server Edition with NVIDIA ConnectX-8 08:14 NVIDIA PCIe GPUs in standard Supermicro Servers 08:27 Supermicro NVIDIA GB300 NVL72 liquid-cooled rack 09:09 Supermicro ORV3 Power Shelves and 5.5kW PSUs 10:20 NVIDIA NVLink Spine 11:10 NVIDIA Spectrum-X, Spectrum-4, and ConnectX-8 12:08 Supermicro Liquid-Cooled AI Factory 12:13 Supermicro In-Row CDU 12:58 Supermicro Designs Secondary Liquid-Cooling Loops 13:37 Power Delivery 14:35 Supermicro Rear Door Heat Exchangers 16:20 Supermicro Liquid-to-Air Sidecar 17:09 Supermicro Liquid Cooling Towers 18:32 Supermicro DCBBS or Data Center Building Block Solutions 18:44 Supermicro's and NVIDIA's Management and Software Stacks 19:44 Key Lessons Learned