Re: Sounds nice, but reality matters
CPUs already exploit ridiculous quantities of instruction level parallelism (running instructions out of order if they don't depend on each other, and speculative execution, like you said). It just runs into diminishing returns at some point.