Re: It's been a disgrace for years
As seems to invariably be the case when politicians and civil servants are involved, inertia is the order-of-the-day, and little if anything gets done, and what is done amounts to little more than tinkering around the edges, whilst allowing the root problems to keep expanding.
Pretty much, because our model of government actively stops civil servants making decisions, and requires them to be passed up the chain to elected politicians. With the average minister of the past fifteen years having only lasted about 22 months in office, most of the time they're the blind leading the hand-tied. Culturally, the Civil Service has also become averse to taking the initiative or innovating, and as a result has very little results focus. I base that on the fact that I've been a civil servant for around five years, but can contrast it to 30+ years private sector experience.
What needs to be different here is a few simple things, but that are culturally difficult for the incumbents of both Westminster and Whitehall. For starters, civil servants need more freedom to exercise some decision making, with that limited by scope to avoid any undemocratic policy changes or major commitments being made without approval, and subject to post-hoc review and approval. That's not really any different from giving senior managers in business their own P&L. Next up, senior civil servants need to be made accountable, and then held to account for their decisions, and the inept need clearing out. And finally, like most of the private sector the Civil Service needs to have bonus schemes that tie a chunk of their pay to ensuring the right things happen. There is a Senior Civil Service incentive scheme, but its a lower share of pay than typical private sector schemes, and more important it is largely tied to trivia like ensuring that their teams have done all their mandatory training and crap like that, not to the outcomes that the public care about.
I think that the biggest problem is expecting a minister to give up power. Although they are over-worked*, have too much responsibility, and too little time to focus on the big picture, can you see any politician agreeing to delegate power to their mandarins? They're quite happy to outsource their thinking to a SpAd, but pretty reluctant to actual use the capabilities of the large organisations who work for their permanent secretary. Whilst the public opinion of the Civil Service is near-universally negative, it is for the most part a professionally run organisation of capable and committed people, but fails to live up to its potential largely for the reasons above, plus a bad habit of giving people specific roles and then not using their other skills and experience more widely.
* Some have been lazy fuckers, but the actual volume of decisions they have to make is enormous. Not unusual for a minister to spend all day in the office, and then be handed his red box with 70 or so papers that they are supposed to read and make decisions on.