NVIDIA™ H200 Tensor Core GPU

Supercharging AI and HPC workloads. 

• NVIDIA H200 Tensor Core GPU boosts generative AI and HPC workloads with exceptional performance and memory.
• Powered by NVIDIA Hopper™ architecture.
• First GPU with 141 GB of HBM3e memory at 4.8 TB/s—nearly double the capacity of H100.
• 1.4X more memory bandwidth for accelerated AI, large language models, and scientific computing.
• Enhanced energy efficiency and lower total cost of ownership.

• AI inference accelerator designed for maximum throughput at the lowest TCO.
• H200 GPU doubles inference performance compared to H100, ideal for large language models like Llama 2 70B.

• 141GB of HBM3e GPU memory
• 4.8TB/s of memory bandwidth
• 4 petaFLOPS of FP8 performance
• 2X LLM inference performance
• 110X HPC performance

• Enterprise-Ready: AI Software Streamlines Development and Deployment

  NVIDIA H200 NVL is bundled with a five-year NVIDIA AI Enterprise subscription and simplifies the way you build an enterprise AI-ready platform. H200 accelerates AI development and deployment for production-ready generative AI solutions, including computer vision, speech AI, retrieval augmented generation (RAG), and more. NVIDIA AI Enterprise includes NVIDIA NIM™, a set of easy-to-use microservices designed to speed up enterprise generative AI deployment. Together, deployments have enterprise-grade security, manageability, stability, and support. This results in performance-optimized AI solutions that deliver faster business value and actionable insights.

Key Features

• Dual-Socket, AMD EPYC™ 9004 Series Processors
• High density 4U system with NVIDIA® HGX™ H100/H200 8-GPU
• 8 NVMe for NVIDIA GPUDirect Storage
• 8 NIC for NVIDIA GPUDirect RDMA (1:1 GPU Ratio)
• Highest GPU communication using NVIDIA® NVLink®
• 24 DIMM slots Up to 6TB: 4800 ECC DDR5
• 8 PCIe 5.0 x16 LP slots
• 2 PCIe 5.0 x16 FHHL slots, 2 PCIe 5.0 x16 FHHL slots (optional)
• 4x 5250W(2+2) Redundant Power Supplies, Titanium Level

Key Applications

• High Performance Computing
• AI/Deep Learning Training
• HPC
• Deep Learning/AI/Machine Learning Development

Key Features

• 5th/4th Gen Intel® Xeon® Scalable processor support
• 32 DIMM slots Up to 8TB: 32x 256 GB DRAM Memory Type: 5600MTs ECC DDR5
• 8 PCIe Gen 5.0 X16 LP
• 2 PCIe Gen 5.0 X16 FHHL Slots, 2 PCIe Gen 5.0 X16 FHHL Slots (optional)
• Flexible networking options
• 2 M.2 NVMe for boot drive only
• 16x 2.5" Hot-swap NVMe drive bays (12x by default, 4x optional)
• 3x 2.5" Hot-swap SATA drive bays
• Optional: 8x 2.5" Hot-swap SATA drive bays
• 10 heavy duty fans with optimal fan speed control
• Optional: 8x 3000W (4+4) Redundant Power Supplies, Titanium Level
• 6x 3000W (4+2) Redundant Power Supplies, Titanium Level

Key Applications

• High Performance Computing
• AI/Deep Learning Training
• Industrial Automation, Retail
• Healthcare
• Conversational AI
• Business Intelligence & Analytics
• Drug Discovery
• Climate and Weather Modeling
• Finance & Economics