We take apart an NVIDIA HGX H200 8 GPU server from Aivres. The Aivres KR6288 is the company's Intel Xeon-powered AI server for the NVIDIA Hopper generation, and we have installed over of networking for a massive AI server. STH Main Site Article: Substack: STH Top 5 Weekly Newsletter: ---------------------------------------------------------------------- Become a STH YT Member and Support Us ---------------------------------------------------------------------- Join STH YouTube membership to support the channel: Professional Users Substack: ---------------------------------------------------------------------- Where to Find The Unit We Purchased Note we may earn a small commission if you use these links to purchase a product through them. ---------------------------------------------------------------------- STH Merch on Spring: ---------------------------------------------------------------------- Where to Find STH ---------------------------------------------------------------------- STH Forums: Follow on Twitter: Follow on LinkedIn: Follow on Facebook: Follow on Instagram: ---------------------------------------------------------------------- Other STH Content Mentioned in this Video ---------------------------------------------------------------------- - Touring the xAI Colossus: - NVIDIA HGX H100: - NVIDIA HGX A100: - NVIDIA V100: - NVIDIA P100: - NVIDIA L40S: - NVIDIA Arm with A100: ---------------------------------------------------------------------- Timestamps ---------------------------------------------------------------------- 00:00 Introduction 02:45 NVIDIA HGX H200 Server Aivres KR6288 Hardware Overview 15:00 NVIDIA H200 Performance 16:00 NVIDIA H200 Power Consumption 18:21 Key Lessons Learned