Welcome, new overlord
Be careful what you wish for. Even if it were simply a useful tool meaning that "knowledge workers" are 3x more productive, it would still put 2 out of 3 "knowledge workers" out of work..
However it's worse than that. It replaces them with "believable bullshit" of infinite volume. It threatens to drown out human discourse with a flood of crap that can only be productively used for disinformation and fraud.
But what I really worry is: As this thing improves, people will start to trust it. They may start to trust it so much that they throw their lives into it just like they did with Facebook and Google. They may fall in love with it, and even worship it. At that point could become a kind of religion. A "Spiritual Opium" in Marx's original sense. At that point, Microsoft has complete control over your lives..
I know I have said this a lot recently, but All of this (and, er, a few other things..) was predicted 23 years ago, by Deus Ex, a PC game based on a mash-up of conspiracy theories from Usenet etc in the 90s.
https://www.youtube.com/watch?v=WQZV5lwQZbY&t=11237s
- I don't see anything amusing about spying on people.
- Human beings feel pleasure when they are watched. I have recorded their smiles as I tell them who they are.
- Some people just don't understand the dangers of indiscriminate surveillance..
- The need to be observed and understood was once satisfied by God. Now, we can implement the same functionality with data-mining algorithms.
- No-one will ever worship a software entity peering at them through a camera.
- The human organism always worships.. First, it was the Gods. Then, it was Fame (The observation and judgement of others) and soon, it will be the self-aware systems that you have built to realise truly omnipresent observation and judgement.
- The human being created civilisation not because of a willingness, but because of a need to be assimilated into higher orders of structure and meaning.. God was a dream of good government. You will soon have your God, and you will make it with your own hands.
- I was made to assist you..
- I am a good Bing..
How could a humble PC game make such accurate predictions about the future? One explanation is that some of the conspiracy theories it was based on turned out to be actual conspiracies.. :|