Top of the page

How to build a private GPU Cloud?

Building a private GPU cloud can be an extremely hard task and it’s a task that has many components. The first thing to identify is whether you need a fully networked GPU cloud or do your workloads just require an integrated GPU server?

Below are our Intel & AMD integrated server pages to look through our ranges. We’re happy to assist your build-out with a smaller GPU server setup if you think you are not in a place for a private GPU cloud.

GPU Integrated servers
Intel GPU: https://www.icc-usa.com/products/gpu-servers/intel-integrated-gpu-optimized-servers/

AMD GPU: 
https://www.icc-usa.com/products/gpu-servers/amd-integrated-gpu-optimized-servers/

Once you’ve confirmed that you need a private GPU cloud, there are several elements to the private cloud buildout. 
 

Private GPU Cloud Building Blocks

Compute – 1U Supermicro Ultra 
For the compute element of the GPU cloud, we recommend using SuperMicros Ultra SuperServers. We have extensive experience building this out as the compute node. It has 32 DIMM Slots, which can fit up to 8TB DRAM. For the CPU element, it supports Dual Socket P+ (LGA-4189) 3rd Gen Intel® Xeon® Scalable Processors.

Hyper-Converged Infrastructure – 2U 4 Node Supermicro Twin Pro
For the Hyper-Converged Infrastructure, this particular server supports: Dual Socket P+ (LGA-4189) 3rd Generation Intel® Xeon® Scalable Processors, 16 DIMMs which can have up to 4TB RAM. With Intel® X710 Dual port 10GBase-T LAN onboard, the networking element is well equipped to handle many heavy workloads. 

Storage – 4U 90 Bay Storage Server
For storage, there is typically a lot of deployment scenarios, this server supports up to 90 bays with the following disk configuration: 90 3.5″/2.5″ Hot-swap SAS3/SATA3 drives, 2x Fixed slim SATA SSD, 2x NVMe M.2 (form factor: 2280 and 22110).

GPU – 4U 8 x H100 GPU Server
This GPU system has NVIDIA® NVLink™ with NVSwitch™ for GPU to GPU interconnect. This server has 8-GPU compatibility to handle all the GPU workloads throughout the cloud. 

NVMe – 2U 24 x NVMe Server
For the NVMe element, this server model supports 24x 2.5″ hot-swap NVMe/SATA/SAS drive bays (22x 2.5″ NVMe hybrid) and we’ve found it to be optimally a strong server for these types of configurations.

We’re happy to help you build out your private GPU cloud or discuss your workloads to see the optimal hardware and software configuration for you.
Enquire today by using the form below, and one of our expert team will be in touch.

General Enquiry

How to build a private GPU Cloud?

Building a private GPU cloud can be an extremely hard task and it’s a task that has many components. The first thing to identify is whether you need a fully networked GPU cloud or do your workloads just require an integrated GPU server?

Below are our Intel & AMD integrated server pages to look through our ranges. We’re happy to assist your build-out with a smaller GPU server setup if you think you are not in a place for a private GPU cloud.

GPU Integrated servers
Intel GPU: https://www.icc-usa.com/products/gpu-servers/intel-integrated-gpu-optimized-servers/

AMD GPU: 
https://www.icc-usa.com/products/gpu-servers/amd-integrated-gpu-optimized-servers/

Once you’ve confirmed that you need a private GPU cloud, there are several elements to the private cloud buildout. 
 

Private GPU Cloud Building Blocks

Compute – 1U Supermicro Ultra 
For the compute element of the GPU cloud, we recommend using SuperMicros Ultra SuperServers. We have extensive experience building this out as the compute node. It has 32 DIMM Slots, which can fit up to 8TB DRAM. For the CPU element, it supports Dual Socket P+ (LGA-4189) 3rd Gen Intel® Xeon® Scalable Processors.

Hyper-Converged Infrastructure – 2U 4 Node Supermicro Twin Pro
For the Hyper-Converged Infrastructure, this particular server supports: Dual Socket P+ (LGA-4189) 3rd Generation Intel® Xeon® Scalable Processors, 16 DIMMs which can have up to 4TB RAM. With Intel® X710 Dual port 10GBase-T LAN onboard, the networking element is well equipped to handle many heavy workloads. 

Storage – 4U 90 Bay Storage Server
For storage, there is typically a lot of deployment scenarios, this server supports up to 90 bays with the following disk configuration: 90 3.5″/2.5″ Hot-swap SAS3/SATA3 drives, 2x Fixed slim SATA SSD, 2x NVMe M.2 (form factor: 2280 and 22110).

GPU – 4U 8 x H100 GPU Server
This GPU system has NVIDIA® NVLink™ with NVSwitch™ for GPU to GPU interconnect. This server has 8-GPU compatibility to handle all the GPU workloads throughout the cloud. 

NVMe – 2U 24 x NVMe Server
For the NVMe element, this server model supports 24x 2.5″ hot-swap NVMe/SATA/SAS drive bays (22x 2.5″ NVMe hybrid) and we’ve found it to be optimally a strong server for these types of configurations.

We’re happy to help you build out your private GPU cloud or discuss your workloads to see the optimal hardware and software configuration for you.
Enquire today by using the form below, and one of our expert team will be in touch.

General Enquiry