Inside a MEGA AI GPU Server with the NVIDIA HGX H200

We take apart an NVIDIA HGX H200 8 GPU server from Aivres. The Aivres KR6288 is the company's Intel Xeon-powered AI server for the NVIDIA Hopper generation, and we have installed over 3.6Tbps of networking for a massive AI server. STH Main Site Article: Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ ---------------------------------------------------------------------- Where to Find The Unit We Purchased Note we may earn a small commission if you use these links to purchase a product through them. ---------------------------------------------------------------------- STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - Touring the xAI Colossus: https://youtu.be/Jf8EPSBZU7Y - NVIDIA HGX H100: https://youtu.be/4Np1HnWiHb4 - NVIDIA HGX A100: https://youtu.be/E6HJi0iqYbw - NVIDIA V100: https://youtu.be/2FV5zHO1z1M - NVIDIA P100: https://youtu.be/ipQXdjjAPGg - NVIDIA L40S: https://youtu.be/yKOg1DjtB50 - NVIDIA Arm with A100: https://youtu.be/t4dPmgZqWdk ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 02:45 NVIDIA HGX H200 Server Aivres KR6288 Hardware Overview 15:00 NVIDIA H200 Performance 16:00 NVIDIA H200 Power Consumption 18:21 Key Lessons Learned