128GB with 200GbE NVIDIA DGX Spark is GREAT for Local AI

The NVIDIA DGX Spark with 128GB of LPDDR5X memory, a 20-core Arm CPU, Blackwell GPU, 200GbE RDMA NVIDIA ConnectX-7 networking, 10GbE, and more is great. This is going to be THE hotness for running local AI models in a sub 200W envelope for the entire system per node. STH Main Site Article: https://www.servethehome.com/nvidia-dgx-spark-review-the-gb10-machine-is-so-freaking-cool/ Substack: https://axautikgroupllc.substack.com/ STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09 ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join Professional Users Substack: https://axautikgroupllc.substack.com/ ---------------------------------------------------------------------- Where to Find The Unit We Purchased Note we may earn a small commission if you use these links to purchase a product through them. ---------------------------------------------------------------------- STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/ ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: https://forums.servethehome.com Follow on Twitter: https://twitter.com/ServeTheHome Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/ Follow on Facebook: https://www.facebook.com/ServeTheHome/ Follow on Instagram: https://www.instagram.com/servethehome/ ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - MikroTik CRS812 DDQ Video: https://youtu.be/rX46MLBOIok - MikroTik CRS812 DDQ: https://www.servethehome.com/mikrotik-crs812-ddq-400gbe-switch-launched-crs812-8ds-2dq-2ddq-marvell/ - Dell Pro Max with GB10: https://www.servethehome.com/dell-pro-max-with-gb10-unboxing-this-nvidia-gb10-arm-blackwell-ai-workstation/ - Dell Pro Max with GB10 short on the @STHLabs channel: https://youtube.com/shorts/zkc1OEOFMus ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction to the NVIDIA DGX Spark 01:06 NVIDIA GB10 Hardware Overview 06:35 200GbE RDMA Networking Setups 10:28 Setup and Power Consumption 15:17 Software, NVIDIA Sync with Cursor and Open WebUI Ollama Performance 18:41 Key Lessons Learned and Who This is For