SuperMicro begins shipping NVIDIA GH200 Grace Hopper Servers
This is the news a lot of server procurement teams have been waiting for.
SuperMicro has begun shipping the GH200 Grace Hopper servers - and the line is extremely powerful.
SuperMicro is going heavy for AI use cases and they’ve released what can only be described as the most broad range of Grace Hopper servers there is.
“The new modular architecture is designed to standardize AI infrastructure and accelerated computing in compact 1U and 2U form factors while providing ultimate flexibility and expansion ability for current and future GPUs, DPUs, and CPUs. Supermicro’s advanced liquid-cooling technology enables very high-density configurations, such as a 1U 2-node configuration with 2 NVIDIA GH200 Grace Hopper Superchips integrated with a high-speed interconnect. Supermicro can deliver thousands of rack-scale AI servers per month from facilities worldwide and ensures Plug-and-Play compatibility.”
Supermicro’s new line of servers includes:
- ARS-111GL-NHR – 1 NVIDIA GH200 Grace Hopper Superchip, Air-Cooled
- ARS-111GL-NHR-LCC – 1 NVIDIA GH200 Grace Hopper Superchip, Liquid-Cooled
- ARS-111GL-DHNR-LCC – 2 NVIDIA GH200 Grace Hopper Superchips, 2 Nodes, Liquid-Cooled
- ARS-121L-DNR – 2 NVIDIA Grace CPU Superchips in each of 2 Nodes, 288 Cores in total
- ARS-221GL-NR – 1 NVIDIA Grace CPU Superchip in 2U
- SYS-221GE-NR – Dual-socket 4th Gen Intel Xeon Scalable processors with up to 4 NVIDIA H100 Tensor Core or 4 NVIDIA PCIe GPUs
“Supermicro’s 1U NVIDIA MGX systems have up to 2 NVIDIA GH200 Grace Hopper Superchips featuring 2 NVIDIA H100 GPUs and 2 NVIDIA Grace CPUs. Each comes with 480GB LPDDR5X memory for the CPU and 96GB of HBM3 or 144GB of HBM3e memory for the GPU. The memory-coherent, high-bandwidth, low-latency NVIDIA-C2C interconnects the CPU, GPU, and memory at 900GB/s — 7 times faster than PCIe 5.0. The modular architecture provides multiple PCIe 5.0 x16 FHFL slots to accommodate DPUs for cloud and data management and expandability for additional GPUs, networking, and storage.
With the 1U 2-node design featuring 2 NVIDIA GH200 Grace Hopper Superchips, Supermicro’s proven direct-to-chip liquid cooling solutions can reduce OPEX by more than 40% while increasing computing density and simplifying rack-scale deployment for large language model (LLM) clusters and HPC applications.
The 2U Supermicro NVIDIA MGX platform supports both NVIDIA Grace and x86 CPUs with up to 4 full-size data center GPUs, such as the NVIDIA H100 PCIe, H100 NVL, or L40S. It also provides three additional PCIe 5.0 x16 slots for I/O connectivity, and eight hot-swap EDSFF storage bays.”
As a premier SuperMicro partner, we are happy to build out your use case and expedite delivery for you for all of these new solutions.
GPU ARS-111GL-NHR
Specifications:
- CPU Manufacture: NVIDIA
- CPU: NVIDIA GH200 Grace Hopper™ Superchip
- Core Count: Up to 72C/144T
- Note: Supports up to 1000W TDP CPUs (Air Cooled)
- Max GPU Count: 1 onboard GPU(s)
- CPU-GPU Interconnect: NVLink®-C2C
- GPU-GPU Interconnect: PCIe
- System Memory: Up to 480GB: Onboard LPDDR5X (and additional 96GB HBM3 for GPU)
- Chipset: System on Chip
- Network Connectivity: 1x 1GbE BaseT with NVIDIA ConnectX®-7 or Bluefield®-3 DPU
- LAN: 1 RJ45 1GbE (Dedicated IPMI port)
- USB: 2 USB port(s) (2 rear)
- BIOS Type: AMI 32MB SPI Flash EEPROM
- PC Health Monitoring - CPU: 8+4 Phase-switching voltage regulator. Monitors for CPU Cores, Chipset Voltages, Memory
- FAN: Fans with tachometer monitoring, Pulse Width Modulated (PWM) fan connectors, Status monitor for speed control
- Temperature: Monitoring for CPU and chassis environment. Thermal Control for fan connectors
ARS-111GL-DNHR-LCC (Silver)
Specifications:
- CPU: NVIDIA GH200 Grace Hopper™ Superchip
- Core Count: Up to 72C/144T
- Note: Supports up to 2000W TDP CPUs (Liquid Cooled)
- Max GPU Count: 1 onboard GPU(s)
- CPU-GPU Interconnect: NVLink®-C2C
- GPU-GPU Interconnect: PCIe
- System Memory: Up to 480GB: Onboard LPDDR5X (and additional 96GB HBM3 for GPU)
- Chipset: System on Chip
- Network Connectivity: 1x 1GbE BaseT with NVIDIA ConnectX®-7 or Bluefield®-3 DPU
- LAN: 1 RJ45 1GbE (Dedicated IPMI port)
- BIOS Type: AMI 32MB SPI Flash EEPROM
- PC Health Monitoring - CPU: 8+4 Phase-switching voltage regulator. Monitors for CPU Cores, Chipset Voltages, Memory
- FAN: Fans with tachometer monitoring, Pulse Width Modulated (PWM) fan connectors, Status monitor for speed control
- Temperature: Monitoring for CPU and chassis environment. Thermal Control for fan connectors
General Enquiry
SuperMicro begins shipping NVIDIA GH200 Grace Hopper Servers
This is the news a lot of server procurement teams have been waiting for.
SuperMicro has begun shipping the GH200 Grace Hopper servers - and the line is extremely powerful.
SuperMicro is going heavy for AI use cases and they’ve released what can only be described as the most broad range of Grace Hopper servers there is.
The new modular architecture is designed to standardize AI infrastructure and accelerated computing in compact 1U and 2U form factors while providing ultimate flexibility and expansion ability for current and future GPUs, DPUs, and CPUs. Supermicro’s advanced liquid-cooling technology enables very high-density configurations, such as a 1U 2-node configuration with 2 NVIDIA GH200 Grace Hopper Superchips integrated with a high-speed interconnect. Supermicro can deliver thousands of rack-scale AI servers per month from facilities worldwide and ensures Plug-and-Play compatibility.
Supermicro’s new line of servers includes:
- ARS-111GL-NHR – 1 NVIDIA GH200 Grace Hopper Superchip, Air-Cooled
- ARS-111GL-NHR-LCC – 1 NVIDIA GH200 Grace Hopper Superchip, Liquid-Cooled
- ARS-111GL-DHNR-LCC – 2 NVIDIA GH200 Grace Hopper Superchips, 2 Nodes, Liquid-Cooled
- ARS-121L-DNR – 2 NVIDIA Grace CPU Superchips in each of 2 Nodes, 288 Cores in total
- ARS-221GL-NR – 1 NVIDIA Grace CPU Superchip in 2U
- SYS-221GE-NR – Dual-socket 4th Gen Intel Xeon Scalable processors with up to 4 NVIDIA H100 Tensor Core or 4 NVIDIA PCIe GPUs
Supermicro’s 1U NVIDIA MGX systems have up to 2 NVIDIA GH200 Grace Hopper Superchips featuring 2 NVIDIA H100 GPUs and 2 NVIDIA Grace CPUs. Each comes with 480GB LPDDR5X memory for the CPU and 96GB of HBM3 or 144GB of HBM3e memory for the GPU. The memory-coherent, high-bandwidth, low-latency NVIDIA-C2C interconnects the CPU, GPU, and memory at 900GB/s — 7 times faster than PCIe 5.0. The modular architecture provides multiple PCIe 5.0 x16 FHFL slots to accommodate DPUs for cloud and data management and expandability for additional GPUs, networking, and storage.
With the 1U 2-node design featuring 2 NVIDIA GH200 Grace Hopper Superchips, Supermicro’s proven direct-to-chip liquid cooling solutions can reduce OPEX by more than 40% while increasing computing density and simplifying rack-scale deployment for large language model (LLM) clusters and HPC applications.
The 2U Supermicro NVIDIA MGX platform supports both NVIDIA Grace and x86 CPUs with up to 4 full-size data center GPUs, such as the NVIDIA H100 PCIe, H100 NVL, or L40S. It also provides three additional PCIe 5.0 x16 slots for I/O connectivity, and eight hot-swap EDSFF storage bays.
As a premier SuperMicro partner, we are happy to build out your use case and expedite delivery for you for all of these new solutions.
GPU ARS-111GL-NHR
Specifications:
- CPU Manufacture: NVIDIA
- CPU: NVIDIA GH200 Grace Hopper™ Superchip
- Core Count: Up to 72C/144T
- Note: Supports up to 1000W TDP CPUs (Air Cooled)
- Max GPU Count: 1 onboard GPU(s)
- CPU-GPU Interconnect: NVLink®-C2C
- GPU-GPU Interconnect: PCIe
- System Memory: Up to 480GB: Onboard LPDDR5X (and additional 96GB HBM3 for GPU)
- Chipset: System on Chip
- Network Connectivity: 1x 1GbE BaseT with NVIDIA ConnectX®-7 or Bluefield®-3 DPU
- LAN: 1 RJ45 1GbE (Dedicated IPMI port)
- USB: 2 USB port(s) (2 rear)
- BIOS Type: AMI 32MB SPI Flash EEPROM
- PC Health Monitoring - CPU: 8+4 Phase-switching voltage regulator. Monitors for CPU Cores, Chipset Voltages, Memory
- FAN: Fans with tachometer monitoring, Pulse Width Modulated (PWM) fan connectors, Status monitor for speed control
- Temperature: Monitoring for CPU and chassis environment. Thermal Control for fan connectors
ARS-111GL-DNHR-LCC (Silver)
Specifications:
- CPU: NVIDIA GH200 Grace Hopper™ Superchip
- Core Count: Up to 72C/144T
- Note: Supports up to 2000W TDP CPUs (Liquid Cooled)
- Max GPU Count: 1 onboard GPU(s)
- CPU-GPU Interconnect: NVLink®-C2C
- GPU-GPU Interconnect: PCIe
- System Memory: Up to 480GB: Onboard LPDDR5X (and additional 96GB HBM3 for GPU)
- Chipset: System on Chip
- Network Connectivity: 1x 1GbE BaseT with NVIDIA ConnectX®-7 or Bluefield®-3 DPU
- LAN: 1 RJ45 1GbE (Dedicated IPMI port)
- BIOS Type: AMI 32MB SPI Flash EEPROM
- PC Health Monitoring - CPU: 8+4 Phase-switching voltage regulator. Monitors for CPU Cores, Chipset Voltages, Memory
- FAN: Fans with tachometer monitoring, Pulse Width Modulated (PWM) fan connectors, Status monitor for speed control
- Temperature: Monitoring for CPU and chassis environment. Thermal Control for fan connectors