Mechanism · Bandwidth limits and compartmentalization
Parallel scale-up switches are hard enforcement points
On this page
SignificantTheoretical argumentOpen
In GB200 topologies, GPUs reach GPUs in other nodes through NVSwitches without a NIC on the path. Amodo notes that limits are hard to enforce there because many switches work in parallel, so compromising one or two would bypass the limit.
Sources: [7]