I know he thinks this is a profound idea but to me it just sounds like an attempt to make something uncomfortable, humans sometimes making wrong or bad decisions, more palatable by slipping a non-human into the decision point. It is the trolley problem where it is pulling a switch vs pushing a person on the tracks to stop the trolley. He is just wanting to put a LLM/AI there to take the blame.
In the medical example, the reason why we would put a person in the loop is because we have decided the decisions need judgement that only experience can provide, or is complex enough that it is had to distill it to a deterministic system, or finally it is 'more moral' feeling.
But I am not certain the answer is to drop yet another non-deterministic system into the place of a human and say, 'this is better'. If something goes wrong, we can always go to the human, ask questions, ask what happened and then develop new standards that fix the problem. A LLM is by definition a black-box, non-deterministic system, which has all the same drawbacks, plus more. If the LLM starts making bad decisions, the only thing we can do is pull it and try training it another way and hope it doesn't do it again?
The problem addressed in his example is trivially solved. Yes a human cannot make fast decisions, endlessly for hours on end like an LLM but that is why people in the positions don't do that work for hours endlessly. There is a reason why air traffic controllers at busy airports typically only do traffic routing for a couple hours at a time at most.
I know it must be hard when you paycheck is signed for a company the treats everyone as cogs to be worn down and replaced with another. I live in Amazon's backyard, the friends I have who have worked for them will retort, 'Well, it looks good on the resume that I worked at Amazon when I go look for other tech work.' But their resume has them doing a singular task for years and doesn't really show a breadth of skill, they were a cog and unless I am hiring for a cog there will be more that look better.