Already Here?
We already use parallel processing to a certain extent. It's called multi-threading, the only real difference being that the processor and underlying OS handles this parallelism by such techniques a time slicing. The reason for avoiding it in the past has been the additional complexity it adds to the code and the greater dificulty in testing. Even the humble smartphone uses it, particularly when connecting to the network or running some kind of media, requiring asynchronous and time-boxed funtionality such as screen refresh for animation.
So initially we should see an improvement in the OS as it handles multiple threads truely in parallel followed by more complex software being able to run faster and more efficiently, making it possible for higher AI functions to be implemented on more compact devices. Currently SIRI is being run as a thin client to a massive backend engine but that could change with this new chipset. Also facial recognition and security could be improved, not to mention how speech recognition would expand to speech comprehension and translation.
I think what scares people the most is the idea of extreme parallel processing of the sort needed to analyse or create video in real time, where each pixel is subjected to its own process but this is already happening with video graphics cards. Or my personal favourite, neural networks where each 'neuron' is given its own process to react independently of but collaborativley with other neurons to form a network. That's the kind of parallel processing I am looking forward to.