It is about accountability
For the long version, see How to Hold Algorithms Accountable. My own short view is that you need to be able to explain how an algorithm came up with a specific outcome, when such question was to be asked. Also if usually no-one usually asks such questions, because they just might, some day. Then try to put yourself in the customer shoes and see how your explanation is likely to fly.
Biting the hand that feeds IT
