Now THIS is an Arm Server! Ampere Altra Max NVIDIA AI Server

In this video, we take a look at the 128-core Ampere Altra Max powered Gigabyte G242-P32 Arm-server with two NVIDIA A100 80GB GPUs. NVIDIA is pushing Arm CPUs plus NVIDIA GPUs from the edge to the high-performance computing data center segment. In this video, we take a look at the system that is the foundation for the NVIDIA Arm HPC Developer's Kit and see what it is like to use one of these systems. STH Main Site Article: https://www.servethehome.com/the-most-important-server-of-2022-the-gigabyte-ampere-altra-max-and-nvidia-a100/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 04:56 Gigabyte G242-P32 Server Hardware Overview 12:56 Getting started with an Ampere Arm and NVIDIA A100 Server 18:10 Performance 22:32 Impact of this NVIDIA Arm System 25:00 Final Words ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - Ampere Altra 2x 80C Wiwynn - https://youtu.be/jESiMLQVNf4 - More Cores, More Better - https://youtu.be/avxg-XRmk8A - Intel QAT Acceleration Cards- https://youtu.be/vcxJdRMhQ3o - Intel Ice Lake Acceleration - https://youtu.be/CbANr1BztEw - Cavium ThunderX Gigabyte Server - https://www.servethehome.com/gigabyte-r270-t61-2u-96-core-cavium-thunderx-server-review/ - Marvell Cavium ThunderX2 - https://www.servethehome.com/cavium-thunderx2-review-benchmarks-real-arm-server-option/