NVIDIA DGX H100

NVIDIA DGX H100

The gold standard for AI infrastructure.

Artificial intelligence is now the go-to approach for solving difficult business challenges. Whether through improving customer service, optimizing supply chains, extracting business intelligence, or designing cutting-edge products and services across nearly every industry, AI gives organizations the mechanism to realize innovation. And as a pioneer in AI infrastructure, NVIDIA DGX™ systems provide the most powerful and complete AI platform for bringing these essential ideas to fruition.

NVIDIA DGX H100 powers business innovation and optimization. The latest iteration of NVIDIA’s legendary DGX systems and the foundation of NVIDIA DGX SuperPOD™, DGX H100 is an AI powerhouse that features the groundbreaking NVIDIA H100 Tensor Core GPU. The system is designed for the singular purpose of maximizing AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommender systems, data analytics, and much more. Available on premises, DGX H100 delivers the performance needed for enterprises to solve the biggest challenges with AI.

SYSTEM SPECIFICATIONS

GPU 8x NVIDIA H100 Tensor Core GPUs
GPU memory 640GB total
Performance 32 petaFLOPS FP8
NVIDIA® NVSwitch™ 4x
System power
usage
11.3kW max
CPU Dual Intel® Xeon® Platinum 8480C Processors
112 Cores total, 2.00 GHz (Base),
3.80 GHz (Max Boost)
System memory 2TB
Networking 4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI

> 400Gb/s InfiniBand/Ethernet

2x dual-port NVIDIA ConnectX-7 VPI
> 1x 400Gb/s InfiniBand
> 1x 200Gb/s Ethernet

Management network 10Gb/s onboard NIC with RJ45

50Gb/s Ethernet NIC

Host baseboard management controller (BMC) with RJ45

Storage OS: 2x 1.92TB NVMe M.2
Internal storage: 8x 3.84TB NVMe U.2
Software NVIDIA AI Enterprise – Optimized AI software