The HGX A100 is an integrated baseboard that allows for GPU-to-GPU communication between eight A100s, thanks to Nvidia's NVLink and NVSwitch. With the A100's multi-instance capability, the eight ...
eight or even 16 A100 GPUs that can be interconnected with Nvidia’s NVLink and NVSwitch interconnect technology, which provides nearly 10 times the bandwidth of PCIe 4.0, according to Kharya.