NVIDIA HGX H100 8x NVIDIA H100 SXM Baseboard 640 GB HBM3 NVLink 4 Switch

The NVIDIA HGX H100 8-GPU Baseboard is a high-performance platform built on the NVIDIA Hopper architecture, designed to power the most demanding AI, HPC, and data center workloads. It integrates 8 NVIDIA H100 SXM GPUs with a combined 640 GB of HBM3 high-bandwidth memory, delivering exceptional memory capacity and throughput for massive datasets and trillion-parameter AI models. The system leverages the NVLink 4 switch, enabling all-to-all GPU communication with up to 3.6 TB/s of bandwidth, eliminating bottlenecks and ensuring ultra-fast multi-GPU scalability. With features such as the Transformer Engine, FP8 precision, and advanced sparsity acceleration, the HGX H100 8-GPU Baseboard dramatically improves both training and inference efficiency for large language models (LLMs), generative AI, and simulation workloads. Its optimized design delivers unmatched compute density, scalability, and energy efficiency, making it the cornerstone for building AI supercomputers, exascale HPC systems, and hyperscale cloud infrastructure.