Private Cloud configurations are tough to get right. You then layer on the difficulty of picking the right GPU and you have quite the task to put together a highly-performing and affordable GPU cloud. We’ve listed out some of the GPUs here which can help guide you to find the right model to put in your GPU cloud: https://www.icc-usa.com/understanding-nvidia-gpus/
We’ve decided to turn building a private cloud into several building blocks. You can see them below and we’re happy to help you with each element. Each of the building blocks will be edited for your specific needs.
- Hyper-Converged Infrastructure
Compute – 1U Supermicro Ultra
For the compute element of the GPU cloud, we recommend using SuperMicros Ultra SuperServers. We have extensive experience building this out as the compute node. It has 32 DIMM Slots, which can fit up to 8TB DRAM. For the CPU element, it supports Dual Socket P+ (LGA-4189) 3rd Gen Intel® Xeon® Scalable Processors.
Hyper-Converged Infrastructure – 2U 4 Node Supermicro Twin Pro
For the Hyper-Converged Infrastructure, this particular server supports: Dual Socket P+ (LGA-4189) 3rd Generation Intel® Xeon® Scalable Processors, 16 DIMMs which can have up to 4TB RAM. With Intel® X710 Dual port 10GBase-T LAN onboard, the networking element is well equipped to handle many heavy workloads.
Storage – 4U 90 Bay Storage Server
For storage, there is typically a lot of deployment scenarios, this server supports up to 90 bays with the following disk configuration: 90 3.5″/2.5″ Hot-swap SAS3/SATA3 drives, 2x Fixed slim SATA SSD, 2x NVMe M.2 (form factor: 2280 and 22110).
GPU – 4U 8 x H100 GPU Server
This GPU system has NVIDIA® NVLink™ with NVSwitch™ for GPU to GPU interconnect. This server has 8-GPU compatibility to handle all the GPU workloads throughout the cloud.
NVMe – 2U 24 x NVMe Server
For the NVMe element, this server model supports 24x 2.5″ hot-swap NVMe/SATA/SAS drive bays (22x 2.5″ NVMe hybrid) and we’ve found it to be optimally a strong server for these types of configurations.
With all of that considered, you’ll be on your way to building a GPU cloud. Talk to us about building your GPU cloud by using the form below, and one of our expert team will be in touch.
General Enquiry Form
More from our blog
Building a GPU cloud contains many variables, hardware and software. You can think of it as building blocks.
SuperMicro continues to push the boundaries in terms of GPU server deployments and form factors. SuperMicro recently announced an 8U GPU, which, in their words, is the “most advanced GPU server, incorporating eight NVIDIA® H100 Tensor Core GPUs”.
With the rising cost of parts and the expensive DDR5 memory associated with AMD’s new CPUs, retailers are starting to come to grips with the need for more affordable motherboards for the new AMD Ryzen 7000 line.