Re: Next major advance...
I second that. I work for a software defined storage company, and the single biggest problem we face is scalability. Controlled lab environments with small numbers of systems and disks work great, but once you scale up to hundreds of systems you begin to see the inefficiencies of the code, and seemingly trivial I/O tasks suddenly become major bottlenecks.
Every time we solve a problem related to scalability, another client pops up seeking to push the boundaries further. And what for? Do we really need all that data?
I look at Microsoft's $26 billion purchase of LinkedIn as a sign that the big data market has gone insane, and is going to collapse, hard.
Biting the hand that feeds IT
