> If it gets stuff wrong occasionally it doesn't matter, because humans make mistakes and physical parts fail.
It matters unless ‘the machine said so’ ceases to be universal excuse for not only arbitrarily stupid decisions, but also their strict enforcement with no possibility to appeal or negotiate.
Humans make lots of mistakes so they are aware they can make mistakes (with some notable exceptions). Someday the AI that does not exist yet (TAITDNEY) may be advanced far enough so that you can explain it its mistake when it makes one. But currently those trying to replace humans with AIs seem to be doing *because* they can avoid this possibility.