Inside the SUPER NVIDIA H200 Server From Supermicro

We take a look at the giant 8U Supermicro SYS-821GE-TNHR. It is the super popular NVIDIA HGX H100 and H200 platform for air-cooled data centers. While taking it apart, we explain the design and what makes this very different in the industry. Please note: We need to say this is sponsored. Supermicro pulled the expensive system out of the rack for us. It was also cheaper to fly George and me to the server than to fly the server to the STH studio. STH Main Site Article: https://www.servethehome.com/supermicro-sys-821ge-tnhr-8x-nvidia-h200-gpu-air-cooled-bluefield-intel-xeon-astera-broadcom/ Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ ---------------------------------------------------------------------- Where to Find The Unit We Purchased Note we may earn a small commission if you use these links to purchase a product through them. ---------------------------------------------------------------------- STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - Touring the xAI Colossus: https://youtu.be/Jf8EPSBZU7Y - NVIDIA HGX H100: https://youtu.be/4Np1HnWiHb4 - NVIDIA HGX A100: https://youtu.be/E6HJi0iqYbw - NVIDIA V100: https://youtu.be/2FV5zHO1z1M - NVIDIA P100: https://youtu.be/ipQXdjjAPGg - NVIDIA L40S: https://youtu.be/yKOg1DjtB50 - NVIDIA Arm with A100: https://youtu.be/t4dPmgZqWdk ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 10:30 Power Supplies 11:30 Power Consumption 11:57 Networking 4Tbps of Network Bandwidth 18:30 Wrap-up