[adrianco]

This is a water-cooled system, so AWS is going to have to figure out a new datacenter architecture to install and run it. It’s a big investment and commitment from AWS and I expect that part of the deal was that NVIDIA would be a guaranteed customer at scale for the system, in return for things like AWS getting preferential early access to the technology.

[nixgeek]

Based on the 4x 66kW (albeit an A+B design) power shelves in these, this # of systems is basically an entire datacenter for AWS assuming they stuck to ~35MW buildings as they’ve done historically. It will likely be a little larger even than a normal building…

It’s only 288 racks of GPUs, based on 72/rack as NVIDIA disclosed elsewhere. Then whatever ancillary network is required. Pretty wild to use that much power over that few racks.

Seems like critical load when at 100% for the GPU racks is supposed to be 34.5MW and assuming 10% for 800GE networking to plumb it all together and a 1.2 PUE gets you to 45MW overall?