Quick Specs Form Factor: 4U Rack Server Processor | Max: 56 Cores (PP) 2x 4th Gen Intel Xeon Scalable Processors Memory | Max: 4TB 32 DDR5 RDIMM 4800Mhz Storage | Max: 122.88TB 8x 2.5" NVMe SSD8x E3.S NVMe SSD Boot Options BOSS-N1 RAID Controller: S160 (SW RAID)H965i NIC/OCP 2 x 1GbE LOM 1 x OCP 3.0 (x8 PCIe lanes) Remote Management: iDRAC9 PCIe Slots: 4 PCIe slots (4 x16 Gen5) GPU: 4 NVIDIA HGX H100 80GB 700W SXM5 GPUsfully interconnected with NVIDIA NVLink technologyLiquid Assisted Air Cooling for GPUNote: No facility water to rack required Other Versions Dell PowerEdge XE8640 Dell PowerEdge XE9640 Dell PowerEdge XE9680 (Click to View) Ideal for: Artificial Intelligence (AI) Deep Learning (DL) High Performance Computing (HPC) Machine Learning (ML) Virtualization Harness the power of AI Drive traditional AI, HPC and simulation applications with optimized compute and accelerated throughput for automating insights into outcomes. Develop and deploy machine learning models, maximize AI initiatives with the latest NVIDIA® GPUs with a 4-way architecture. Purpose-built performance Efficiently drive traditional AI training, HPC and data analytics applications with four high performance accelerators and air-cooling. Get the ultimate balance of performance, power and price with Intel® CPUs and the newest NVIDIA® H100 Tensor Core GPUs. Drive a wide range of AI workloads with two powerful 4th generation Intel ® Xeon® processors® Four (4) NVIDIA H100 Tensor core 700W SXM5 GPUs for extreme performance, fully interconnected with NVIDIA NVLink technology. Improve training performance with up to 900GB/s bandwidth for GPU-GPU communication, 1.5x more than the previous generation. Built for dense inferencing in fields like oil and gas, finance and healthcare Boost performance with DDR5 memory and PCIe Gen5 support Support for the highest wattage next-gen technologies up to 35°C ambient temperature with a 4U air-cooled design Transform your business Strike the perfect balance between performance, power and cost when deploying a solution to suit your IT strategy. Next generation NVIDIA® GPUs achieve superior AI performance in medical imaging, business decision making applications and most other applications Get continuous data processing and faster I/O performance with GPU Direct Storage transfers, bypassing server CPUs Scale with confidence thanks to support for up to 32 DDR5 memory DIMM slots, up to eight drives and up to 4 PCIe Gen 5 expansion slots Accelerated I/O Throughput Deploy latest generation technologies including DDR5, NVLink, PCIe Gen 5.0, and NVMe SSDs to push the boundaries of data flow and computing possibilities. Up to four PCIe Gen 5 slots and up to 8 drives enable optimal expansion for high-performance AI operations. Supports NVIDIA GDS (GPUDirect® Storage), a direct data path for direct memory access (DMA) transfers between GPU memory and storage, increasing system bandwidth and decreasing latency and utilization load on the CPU 4U air-cooled design chassis supports the highest wattage next-gen technologies in up to 35C ambient Cyber Resilient Architecture for Zero Trust IT environment & operations Security is integrated into every phase of the PowerEdge lifecycle, including protected supply chain and factory-to-site integrity assurance. Silicon-based root of trust anchors end-to-end boot resilience while Multi-Factor Authentication (MFA) and role-based access controls ensure trusted operations. Cooling & Fans With most GPU servers the cooling is a major part of the success of the machine running smoothly and efficiently. The XE8640 Rack Server holds up to 6 Standard (STD) fans installed in the mid tray and up to 5 High performance (HPR) gold grade fans installed on the front of the system. A keynote is that all the fans are hot-swappable and when GPUs are installed you can install the Liquid Assisted Air Cooling for GPU. Note: No facility water to rack required. Air cooling for Processors Up to 6 Standard (STD) fans installed in mid tray help cool the Processors, DIMMs, and Drives. This is the top Layer of the XE8640 4U Rack server. Liquid Assisted Air Cooling for GPU 4 NVIDIA HGX H100 80GB 700W SXM5 GPUs, fully interconnected with NVIDIA NVLink technology. Are cooled by the LAAC and Up to 5 High performance (HPR) gold-grade fans installed on the front of the system. Note: No facility water to rack required. Memory The system memory is organized into eight channels per processor (two memory sockets per channel),16 DIMMs per processor, and 32 DIMMs per system. The system only supports ECC DDR5 memory with speeds up to 4800Mhx on a (1DPC) and 4400Mhz on a (2DPC) configuration. DIMM type Rank per DIMM and Data Width DIMM capacity (GB) Speed (MT/s); Voltage (V); DIMM per channel (DPC) 1 DIMM per channel (DPC) 2 DIMMs per channel (DPC) RDIMM DR X 8 32 GB 4800 MT/s 4400 MT/s DR X 4 64 GB 4800 MT/s 4400 MT/s RDIMM 3DS 4R X 4 128GB 4800 MT/s 4400 MT/s GPU The H100 SMX5 GPUs are on the bottom layer of the XE8640 Rack Server. Three different components make up the bottom layer, PDB, H100 Tray, and the LAAC. The Power Distribution Board sits at the very bottom with the H100 Tray on top. The LAAC gets laid on top of the H100 in the GPU tray to cool the H100 SMX5 GPUs. The Top Tray Layer gets placed on top of this bottom layer to support the CPU. DIMMs, and Drives. Bottom Layer (PDB) The Power Distribution Board is at the very bottom of the XE8640 Bottom Layer. This PDB Connects to the GPU via the Versabay board (VSB). Bottom Layer (GPU Tray) The second layer in the Bottom layer is the GPUs themselves. This tray holds 4 Nvidia H100 SMX5 GPUs and the PCI Switchboard which provides all the PCIe lanes needed for the GPUs to run at full power. Bottom Layer (LAAC) With so much GPU power you'll need a system that can cool these H100's down. This last layer of the Bottom Layer is the Liquid Assisted Air Cooling (LAAC) Radiator which is helped by 5 High performance fans. These fans sit in the front of the chassis. Top Layer The final top layer in this 4U Rack server holds the Drives, CPUs, and DIMMs. The top layer of the XE8640 rack server is cooled down by 6 Standard fans. These fans sit in a mid-fan tray right behind the Drives. This is a GPU-intense server for HPC, AI, and Machine Learning systems. The Dell XE8640 Rack Server supports 4x NVIDIA SMX5 GPUs w/ NVLINK HGX H100 80 GB/700 W. The system board connects to these GPUs via the Versabay Board (VSB). The Versabay Boards are designed to offer flexibility in terms of adding extra functionalities such as additional storage controllers, network interface cards (NICs), or specialized processing units. The Dell PowerEdge XE8640 supports the LAAC liquid Cooling option to help with the system temperature. View the manual for more details into the GPU and cooling. Expansion Slots PCIe Riser Configurations 1. R1A+R4A Location Height Length CPU1 CPU2 Riser R1A Riser R4A PCIe Slot -1 FH HL PCIe Gen5 X16 N/A PCIe Slot -2 FH HL PCIe Gen5 X16 N/A PCIe Slot -3 FH HL N/A PCIe Gen5 X16 PCIe Slot -4 FH HL N/A PCIe Gen5 X16 The XE8640 GPU server only has 1 riser configuration. You simply have the choice of whether to install risers or not. Networking / Boot Options Networking OCP 3.0 The XE8640 has two networking options. The LOM card and the OCP 3.0 Card. The Lom card has the default 2 1GbE Ports. While the OCP 3.0 card can expand the Networking of the XE8640 to 4 Ports at 25GbE.10 GbE x 4, 25 GbE x 2, 25 GbE x 4 Boot Option BOSS-N1 The BOSS-N1 Module saves a drive from being designated the boot option and provides up to 2 M.2 NVMe SSD Drives. These drives are hot-swappable and provide a full OS boot option. Storage Controllers The XE8640 Rack server supports the PERC 12 H965i for Hardware RAID along with the S160 for Software RAID. In addition, the rack server also holds the BOSS-N1 Modular Internal Boot device. This BOSS-N1 holds two M.2 NVMe SSD drives with a capacity of 480GB or 960GB. Supported storage controller card Software RAID● S160 Hardware RAID● H965i Power & Dimensions The PowerEdge XE8640 system supports up to 4 AC or DC power supply units (PSUs) with 3+1 redundancy, autosensing, and auto-switching capability. Similar to the Riser config there is only one choice for a Power Supply Unit. The XE8640 can support up to 4x 2800W 200-240V PSUs. This type of battery is needed when installing a SMX5 GPU which consumes 700W during peak performance. Dimensions & Weight: Width: 447 mm (17.6 inches) Height: 174.3 mm (6.86 inches) Length: 901mm (35.46 inches) Weight: 61.4 kg (135.36 lb)
Related
Related
Related
Related