There are multiple solutions:

  • Generic: PCIe

  • NVIDIA: NVLink and NVSwitch

  • AMD: Infinity Fabric

  • Intel: Gaudi2

  • intra-node unidirectional theoretical peak bandwidth cross-comparison for current technologies sorted by bandwidth