NVIDIA DGX H200

NVIDIA DGX H200

The gold standard for AI infrastructure.

Artificial intelligence is now the go-to approach for solving difficult business challenges. Whether through improving customer service, optimizing supply chains, extracting business intelligence, or designing cutting-edge products and services across nearly every industry, AI gives organizations the mechanism to realize innovation. And as a pioneer in AI infrastructure, NVIDIA DGX™ systems provide the most powerful and complete AI platform for bringing these essential ideas to fruition.

NVIDIA DGX H200 powers business innovation and optimization. The latest iteration of NVIDIA’s legendary DGX systems and the foundation of NVIDIA DGX SuperPOD™ and DGX BasePOD™, DGX H200 is an AI powerhouse that features the groundbreaking NVIDIA H200 Tensor Core GPU. The system is designed for the singular purpose of maximizing AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommender systems, data analytics, and much more. Available on premises, DGX H200 delivers the performance needed for enterprises to solve the biggest challenges with AI.

SYSTEM SPECIFICATIONS

GPU 8x NVIDIA H200 Tensor Core GPUs, with 141GB of GPU memory each
GPU memory 1,128GB total
Performance 32 petaFLOPS FP8
NVIDIA® NVSwitch™ 4x
System power
usage
10.2kW max
CPU Dual Intel® Xeon® Platinum 8480C Processors
112 Cores total, 2.00 GHz (Base),
3.80 GHz (Max Boost)
System memory 2TB
Networking

4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI

> Up to 400Gb/s InfiniBand/Ethernet

2x dual-port QSFP112 NVIDIA ConnectX-7 VPI
> Up to 400Gb/s InfiniBand/Ethernet

Management network

10Gb/s onboard NIC with RJ45

100Gb/s Ethernet NIC

Host baseboard management controller (BMC) with RJ45

Storage OS: 2x 1.92TB NVMe M.2
Internal storage: 8x 3.84TB NVMe U.2
Software NVIDIA AI Enterprise – Optimized AI software
NVIDIA Base Command – Orchestration, scheduling, and cluster management
DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky – Operating System