Reply to post:

"Supercomputer applications are designed to scale across thousand of cores - so unlike PCs those cores are not idle!"

They still wait on I/O like any other CPU, the speed of light still has an impact on how code is written and networks are built. ;)