Re: IBM Summit - 2.4x more storage nodes, 3.2x more NVMe Drives, 12.5x more memory, 5% faster
Re 1) Flash based storage will help. My understanding though from reading the IBM document is that flash is used for small file as well. Given that IBM scored very high on IOPS, (MDtest) I have go to believe that NVMe and the 1TB of memory was instrumental in this result.
re 2) Both IBM Spectrum Scale and WekaIO have a POSIX client that runs on the compute nodes which then communicates with the storage nodes. This is standard across all the parallel file systems including Lustre. It is not using something like NFS, which would never be able to deliver the kind of performance numbers you see on the IO-500.
re 3) No question that the Summit storage system is possibly one of the biggest in the world. The benchmark is all about performance per client, which is a different metric. Our software does not preclude putting disk behind the flash tier to get the great scalability. We leverage object storage and have customers with WDC ActiveScale behind us getting great performance and scalability.
Regarding the motor bike vs, truck analogy, it sounds good but that is not what is happening in the case of the IO-500 test. If you look at the results, you can see that WekaIO did over 2x the bandwidth of Spectrum scale (27GIB/sec vs. 9.8GIB/Sec)