GPU servers come in many shapes and sizes and depending on your use case and your timescales, you can have many GPU nodes working at the same time in parallel.
Putting workloads for GPUs and CPUs in the same box can yield rewards, if done correctly. GPUs and CPUs can share some similar workloads and pairing them together can give exponential benefits.
We’ve put together some integrated servers with GPUs and we’ve got a building block tool for a GPU Cloud Cluster as well.
GPU Integrated servers
GPU Cloud Building Blocks
Compute – 1U Supermicro Ultra
For the compute element of the GPU cloud, we recommend using SuperMicros Ultra SuperServers. We have extensive experience building this out as the compute node. It has 32 DIMM Slots, which can fit up to 8TB DRAM. For the CPU element, it supports Dual Socket P+ (LGA-4189) 3rd Gen Intel® Xeon® Scalable Processors.
Hyper-Converged Infrastructure – 2U 4 Node Supermicro Twin Pro
For the Hyper-Converged Infrastructure, this particular server supports: Dual Socket P+ (LGA-4189) 3rd Generation Intel® Xeon® Scalable Processors, 16 DIMMs which can have up to 4TB RAM. With Intel® X710 Dual port 10GBase-T LAN onboard, the networking element is well equipped to handle many heavy workloads.
Storage – 4U 90 Bay Storage Server
For storage, there is typically a lot of deployment scenarios, this server supports up to 90 bays with the following disk configuration: 90 3.5″/2.5″ Hot-swap SAS3/SATA3 drives, 2x Fixed slim SATA SSD, 2x NVMe M.2 (form factor: 2280 and 22110).
GPU – 4U 8 x H100 GPU Server
This GPU system has NVIDIA® NVLink™ with NVSwitch™ for GPU to GPU interconnect. This server has 8-GPU compatibility to handle all the GPU workloads throughout the cloud.
NVMe – 2U 24 x NVMe Server
For the NVMe element, this server model supports 24x 2.5″ hot-swap NVMe/SATA/SAS drive bays (22x 2.5″ NVMe hybrid) and we’ve found it to be optimally a strong server for these types of configurations.
Overclocked Servers – Vega 116i
Featuring Intel Alder Lake CPU’s by default in a 1U form factor. Our Vega 116i delivers a punch of overclocked performance, offering 8 cores @5.4GHz, thanks to Intel i9-12900KS processors. With up to 128GB DDR4 and accommodating up to 2x 2.5″ SSDs.
Enquire today by using the form below, and one of our expert team will be in touch.
General Enquiry Form
More from our blog
SuperMicro is currently in a pre-registration process for its new X13 servers, which support the 4th Gen of Intel Xeon Scalable Processors.
Modern GPU clouds take significant planning and execution, we are a systems integrator that has plenty of experience with all elements of HPC and we have seen way too many times that planning deficiencies are one of the major causes of problems down the line.
Picking the correct RAID mode is important, especially as data carries a large value to most organizations. With many organizations relying on SuperMicro servers, we wanted to help you a little through the RAID mode understanding process.