"I learned that social scientists have known this for decades and have experimentally shown that people will claim a factor was important in their decision despite only being told it after they’d made the choice."
This is included in the article as a cause for pessimism about AI because it makes it difficult to design a model for the AI. But actually given the current trend of not providing a model just chucking more data at the problem, that's irrelevant. I actually see this as a cause for optimism. Despite some very shoddy software, humans manage to make acceptably good decisions. Therefore the bar for how good our AI software needs to be to be useful is lower than we thought it was.