Japan’s Fugaku supercomputer follow-up adds Nvidia GPUs Japanese research institution RIKEN has decided it needs GPUs for its next generation “FugakuNEXT” supercomputer and has signed Nvidia to supply them and design the systems needed to get them working. RIKEN is home to Fugaku, a machine that from mid-2020 spent two years atop the TOP500 list of Earth’s mightiest supercomputers …
Yeah, they seem to say that going from the 2011's SPARC64 VIIIfx (45 nm) K computer to 2020's A64FX (7 nm) Fugaku they got a 40x perf boost from hw and 3x from sw (120x total).
The way things go now we'll probably be lucky to see 10-20x from 2020 to 2030 (eg. 5-10 ExaFlops at FP64 on dense HPL, with GPUs and a 40 MW power envelope). Then, maybe, with a 5x-10x MxP speedup (sw) that could still yield their 100x target ... where applicable.
It's too bad though that they don't have some ARM Mali/Immortalis/Ethos module to plug into this Next system as accelerator.
