SXM (socket)

SXM boards are typically built with four or eight GPU slots, although some solutions such as the Nvidia DGX-2 connect multiple boards to deliver high performance. While third party solutions for SXM boards exist, most systems integrators such as Supermicro use prebuilt Nvidia HGX boards, which come in four or eight socket configurations.^[5] This solution greatly lowers the cost and difficulty of SXM based GPU servers, and enables compatibility and reliability across all boards of the same generation.^{[citation needed]}

SXM modules on e.g. HGX boards, particularly recent generations, may have NVLink switches to allow faster GPU-to-GPU communication. This further reduces bottlenecks which would normally be imposed by CPU and PCIe limitations.^[2][6] The GPUs on the daughter cards use NVLink as their main communication protocol.^{[clarification needed]} For example, a Hopper-based H100 SXM5 based GPU can use up to 900 GB/s of bandwidth across 18 NVLink 4 channels, with each contributing a 50 GB/s of bandwidth;^[7] In contrast, PCIe 5.0 can handle up to 64 GB/s of bandwidth within a x16 slot.^[8] This high bandwidth also means that GPUs can share memory over the NVLink bus, allowing an entire HGX board to present to the host system as a single, massive GPU.^[9]

Power delivery is also handled by the SXM socket, negating the need for external power cables such as those needed in PCIe equivalent cards. This, combined with the horizontal mounting, allows more efficient cooling mechanisms, which in turn allow SXM-based GPUs to operate at a much higher thermal design power (TDP). The Hopper-based H100, for example, can draw up to 700 W solely from the SXM socket.^[10] The lack of cabling also makes assembling and repairing of large systems much easier, and also reduces the number of possible points of failure.^[2]

Starting from P100,^[11][12][13] to V100,^[14] to A100,^[15] to H100,^[16] to B200^[17][18] and to R100;^[19] the comparison of accelerators used in DGX:

• Tegra – System on a chip by Nvidia