After Computex 2019 in Taipei final 12 months, built-in GPU servers appeared available on the marketNvidia GH200 Grace Hopper Superchipwe now have launched the 2U single node configurationKumoda QuantaGrid S74G-2Uand a 1U dual-node configurationSupermicro ARS-111GL collection,Gigabyte additionally launched2U single-node configuration XH23-VG0, 2U dual-node configuration H223-V10, H263-V11 Mainly, the widespread level of those servers is that all of them use one GH200 chip Ranging from June this 12 months, they’ve been launched available on the market.
The primary server to launch utilizing the GH200 NVL2 is HPE’s newest ProLiant DL384 Gen12. This product comes from the product portfolio technique Nvidia AI Computing by HPE launched by the corporate and Nvidia along with the AI resolution developed by each events known as HPE Personal Cloud AI, overlaying the Nvidia AI Enterprise built-in software program platform and AI inference microservice. NIM.
These servers embrace the present DL320 Gen11 and DL380a Gen11, in addition to the DL384 Gen12 and DL380a Gen12 that had been launched on July 1, HPE introduced the technical specs first on his web site and revealed the {hardware} configuration of the primary model transfer additionally This is similar because the official launch of HPE ProLiant Gen12 technology servers.
DL384 Gen12 makes use of a 2U measurement chassis, and the distant system administration chip continues to be iLO6 As for the computing platform, customers can select to match 1 or 2 GH200 tremendous chips As well as , peripheral gadget entry configuration may be very symmetrical that every super-chip helps the shape issue of two EDSFF NVMe SSDs, 1 full-height and half-width PCIe interface card, and a couple of PCIe x4 interfaces NVMe SSDs, or 1 PCIe x16 OCP 3.0 type issue interface card, or 1 A full-height, half-width PCIe interface card (4 PCIe x16 units).
In different phrases, if the server is configured with two tremendous GH200 chips as a manufacturing unit base, it might probably double the variety of stable state drives and PCIe interface playing cards (eight PCIe x16 units).
When it comes to CPU and GPU specs, if the GH200 NVL2 configuration is used, the computing and reminiscence sources that DL384 Gen12 can use will improve linearly at a ratio of 1:1. For instance, the variety of Arm cores has been Neoverse V2 constructed into the CPU was expanded from 72 to 144, the DRAM LPDDR5X reminiscence capability was expanded from 480 GB to 960 GB, and the HBM3e reminiscence capability paired with the GPU was additionally expanded from 144 GB to 288 GB.
If one Nvidia H100 with a reminiscence capability of 80 GB and a reminiscence bandwidth of three.35 TB/per is used as a benchmark, and two Nvidia H100 GH200 NVL2 are included, the GPU’s reminiscence capability rises to three.5 instances, and the GPU reminiscence bandwidth will increase to three instances.
For the whole server, the overall system reminiscence of GH200 NVL2 can attain 1.2 TB, which is sufficient to deal with memory-intensive computing and reminiscence workloads.
Concerning I/O entry from CPU to GPU, since this super-chip makes use of Nvidia NVLink-C2C, for DL384 Gen12, whether or not it’s between CPU and GPU, or between GPU and GPU over the identical tremendous chip, it might probably present a bandwidth of 900 GB/s between CPUs throughout totally different chips, and a bandwidth of 600 GB/s between CPUs throughout totally different chips.
Along with being the primary to be outfitted with Nvidia GH200 NVL2, which is the largest promoting level, the HPE ProLiant DL384 Gen12 onerous disk storage configuration can be very particular, the whole server can state space for storing onerous to supply 122.8 TB.
Concerning the community interface, DL384 Gen12 can be utilized with Ethernet 10/25GbE, 100GbE specs, and InfiniBand specs community playing cards 200 Gb, 400Gb, or knowledge processor acceleration playing cards, such because the B3220 of BlueField-3 DPU (Band Ethernet or InfiniBand 200GbE). , full top half size), B3140H of BlueField-3 SuperNIC (Ethernet or InfiniBand 400Gb, half top half size).
Product data
HPE ProLiant DL384 Gen12 Laptop
●Unique manufacturing unit: HPE
● Really helpful retail worth: not supplied by the producer
● Chassis measurement: 2U
● Processor: 1 or 2 Nvidia GH200 Grace Hopper Superchip (GH200 or GH200 NVL2)
● Reminiscence: GH200: CPU corresponds to embedded LPDDR5x reminiscence 480 GB, GPU corresponds to HBM3e reminiscence 144 GB;
● Laborious drive capability: 8 E3.S type issue NVMe stable state drives
● Growth interface: PCIe 5.0 x16, 4 full-height and half-length interface playing cards, or 2 half-height and half-length interface playing cards and a couple of OCP 3.0 interface playing cards
● Energy provide: 4 items 1800 to 2200 watts (backup N + N)
[Nòta: Tha mion-chomharrachadh agus prìsean air an toirt seachad leis an neach-dèanamh agus faodaidh iad atharrachadh bho àm gu àm Feuch an cuir thu fios chun neach-dèanamh airson fiosrachadh ceart]
