NVIDIA DGX™ B200

NVIDIA DGX™ B200

A unified AI platform for training, fine-tuning, and inference.

Artificial intelligence is transforming almost every business by automating tasks, enhancing customer service, generating insights, and enabling innovation. It’s no longer a futuristic concept but a reality that’s fundamentally reshaping how businesses operate. However, as AI workloads continue to develop, they’re beginning to require significantly more compute capacity than most enterprises have available.
To leverage AI, enterprises need high-performance computing, storage, and networking capabilities that are secure, reliable, and efficient.

Enter NVIDIA DGX™ B200, the latest addition to the NVIDIA DGX platform. This unified AI platform defines the next chapter of generative AI by taking full advantage of NVIDIA Blackwell GPUs and high-speed interconnects. Configured with eight Blackwell GPUs, DGX B200 delivers unparalleled generative AI performance with a massive 1.4 terabytes (TB) of GPU memory and 64 terabytes per second (TB/s) of HBM3e memory bandwidth, and 14.4 TB/s of all-to-all GPU bandwidth, making it uniquely suited to handle any enterprise AI workload.

With NVIDIA DGX B200, enterprises can equip their data scientists and developers with a universal AI supercomputer to accelerate their time to insight and fully realize the benefits of AI for their businesses.

SYSTEM SPECIFICATIONS

GPU 8x NVIDIA Blackwell GPUs
GPU memory 1,440GB total, 64TB/s HBM3e bandwidth
Performance 72 petaFLOPS FP8 training and 144 petaFLOPS FP4 inference
NVIDIA® NVSwitch™ 2x
System power
usage
~14.3kW max
CPU 2 Intel® Xeon® Platinum 8570 Processors
112 Cores total, 2.1 GHz (Base),
4 GHz (Max Boost)
System memory 2TB, configurable to 4TB
Networking

4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI

> Up to 400Gb/s InfiniBand/Ethernet

2x dual-port QSFP112 NVIDIA BlueField-3 DPU
> Up to 400Gb/s InfiniBand/Ethernet

Management network

10Gb/s onboard NIC with RJ45

100Gb/s dual-port ethernet NIC

Host baseboard management controller (BMC) with RJ45

Storage OS: 2x 1.92TB NVMe M.2
Internal storage: 8x 3.84TB NVMe U.2
Software NVIDIA AI Enterprise – Optimized AI software
NVIDIA Base Command – Orchestration, Scheduling, and Cluster Management
DGX OS / Ubuntu – Operating System