Obviously...
"I think the 'surprising failure mode' is the real story here," [...] Dekker said any highly trained AI is likely to have these blind spots
They do. And finding out why those exist (exactly pinpoint them) is difficult, same for explaining the "answers" a ML model gives you. Yes, there are some techniques, but it still is mostly a black box. Similar to the Kasparov quote above of not having a plan, the model has no concept of truth, justice or beauty. Their (vocal) supporters might suggest otherwise...
Biting the hand that feeds IT
