What's going on with Eos, Nvidia's incredible shrinking supercomputer? Nvidia can't seem to make up its mind just how big its Eos supercomputer is. In a blog post this month re-revealing the ninth most-powerful publicly known supercomputer from last fall's Top500 ranking, the GPU slinger said Eos was built using 576 DGX H100 systems totaling 4,608 GPUs. That's about what we expected when the …
In the good old days Cray would announce their latest bug box and everyone below it on the list would buy one and everyone would laugh at the foreigners for coming in at number 99.
Now nobody cares if your shed full of GPUs is bigger than some other government labs shed full of GPUs.
Of course you care about the sheds full of power sucking devices.
You only get to boast your numbers and performance if it is scaled by the amount of "free" power you are able to extract combined with the amount of cash registers you are allowed to plunder at nanosecond intervals.
In my book, the job of the journalist is to understand and sift issues, and then equally as important to write up the important and urgent matters in terms that say 90% of their audience can understand...and then there's this:
"Oh, and if you're not familiar with the term AI exaFLOPS, it's a metric commonly used to describe floating point performance at lower precision than you'd typically see in double-precision HPC benchmarks, like LINPACK. In this case, Nvidia is arriving at these figures using sparse 8-bit floating point math, but another vendor, like Cerebras, might calculate AI FLOPS using FP16 or BF16."
