NVIDIA DGX H200
The gold standard for AI factory infrastructure.
The World’s Proven Choice for Enterprise AI Factories
Expand the frontiers of business innovation and optimization with NVIDIA DGX™ H200. Part of the NVIDIA DGX platform, DGX H200 is the AI powerhouse that’s the foundation of NVIDIA DGX SuperPOD™ and NVIDIA DGX BasePOD™, accelerated by the groundbreaking performance of the NVIDIA H200 Tensor Core GPU.
The Most Complete AI Factory
The Heart of Your AI Center of Excellence
Build your AI Center of Excellence on NVIDIA DGX H200, a fully integrated hardware and software solution that includes NVIDIA Base Command™, the NVIDIA AI Enterprise software suite, and expert advice from NVIDIA DGXperts.
Break Through Barriers to Scale AI
Get 32 petaFLOPS of AI performance and 2X faster networking than the previous generation, and high-speed scalability with the NVIDIA DGX H200 architecture. The solution is supercharged for the largest workloads, including generative AI, natural language processing, and deep learning recommendation models.
AI Infrastructure Tailored for You
Experience the power of NVIDIA DGX H200 in a multitude of ways that fit your business: on-premises, colocated, rented from managed service providers, and more. And with DGX-Ready Lifecycle Management, organizations get a predictable financial model to keep their deployments leading-edge.
Explore NVIDIA DGX H200
- 8x NVIDIA H200 GPUs with 1,128GBs of Total GPU Memory
18x NVIDIA NVLink® connections per GPU, 900GB/s of bidirectional GPU-to-GPU bandwidth
- 4x NVIDIA NVSwitches™
7.2TB/s of bidirectional GPU-to-GPU bandwidth, 1.5X more than previous generation
- 10x NVIDIA ConnectX®-7 400Gb/s Network Interface
1TB/s of peak bidirectional network bandwidth
- Dual Intel Xeon Platinum 8480C processors, 112 cores total, and 2TB System Memory
Powerful CPUs for the most intensive AI jobs
- 30TB NVMe SSD
High-speed storage for maximum performance
What Customers Are Saying About NVIDIA DGX
- Quote 1
- Quote 2
NVIDIA DGX Offers and Solutions
Specifications
NVIDIA DGX H200
| GPU | 8x NVIDIA H200 Tensor Core GPUs |
| GPU Memory | 1,128GB total |
| Performance | 32petaFLOPS FP8 |
| NVIDIA NVSwitch | 4x |
| System Power Usage | ~10.2kW max |
| CPU | Dual Intel® Xeon® Platinum 8480C Processors
112 cores total, 2.00GHz (Base), 3.80GHz (max boost) |
| System Memory | 2TB |
| Networking | 4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI
Up to 400Gb/s NVIDIA InfiniBand/Ethernet |
| Management Network | 10Gb/s onboard NIC with RJ45
100Gb/s Ethernet optional NIC Host baseboard management controller (BMC) with RJ45 |
| Storage | OS: 2x 1.9TB NVMe M.2
Internal storage: 8x 3.84TB NVMe U.2 |
| Software | NVIDIA AI Enterprise – Optimized AI software
NVIDIA Base Command – Orchestration, scheduling, and cluster management NVIDIA DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky – Operating system |
| System Weight | 287.6lb (130.45kgs) |
| System Dimensions | Height: 14.0in (356mm)
Width: 19.0in (482.2mm) Length: 35.3in (897.1mm) |
| Operating Temperature | 5–30°C (41–86°F) |
Learn More About NVIDIA DGX
Get Started
Take the Next Steps
Get NVIDIA DGX H200
Learn how your organization can deploy the NVIDIA DGX platform.
Discover the NVIDIA DGX Platform
Combining the best of NVIDIA software, infrastructure, and expertise in a modern, unified AI development solution.
NVIDIA DGX Systems Documentation
Access documentation for DGX systems that deliver world-class performance for large generative AI workloads.