https://spectrum.ieee.org/tech-talk/computing/hardware/cerebras-unveils-ai-supercomputer-argonne-national-lab-first-installation Cerebras has introduced the world to its CS-1 system, which will house the company's (and simultaneously, the industry's)
most powerful monolithic accelerator. The CS-1 is an integrated solution the size of 15 industry-standard rack units, and packs everything from the Wafer Scale Engine to cooling systems. The SC-1 consumes 20 kW of power, with a full 4 kW dedicated solely to the cooling subsystem, like fans, pumps, and the heat exchanger, 15 kW dedicated to the chip, and 1 kW is totally lost to power supply inefficiencies. Obviously, power supply modules and other cooling subsystems are redundant, and hot-swappable if need be - you can imagine the computational value lost with each millisecond of downtime that were to occur in such a system.
At 67 centimeters tall, the Cerebras Systems CS-1 offers three times the performance of a Google TPU2 system that takes up 29 times as much space
The SC-1 system houses 12x 100GbE connections for pairing with other traditional compute systems, and the SC-1 is also scalable - multiple systems can be made to work in tandem, multiplying processing power by as many units as are integrated, and the entire system being addressable as a single homogeneous system. Power delivery is made directly into core clusters (remember there are 400,000 of those). Already deployed in the Argonne National laboratory, crunch time on the SC-1 is being used to power through cancer research (what an amazing addition to WCG this would be, right?) and black hole research.
What an incredible engineering feat in my personal opinion.