The Register Home Page

back to article NHS prescribes half a million Copilot licenses for its paperwork headache

NHS England is handing Microsoft Copilot to more than half a million staff after a pilot claimed the AI assistant could claw back 43 minutes a day from administrative work. On Monday, NHS England announced plans to roll out Copilot to 505,000 clinicians and support staff. Its confidence comes from a pilot involving 30,000 staff …

  1. Aladdin Sane Silver badge
    Terminator

    I see no way

    That this will end well.

    1. ecofeco Silver badge

      Re: I see no way

      How about some toast? Ot are you a waffle man?

  2. PCScreenOnly Silver badge

    Worring times

    I recall a thread on here about Google Summariser and an example - besides the summary being longer than the original, a comment from a someone in the medical world indicated that the summarised version was dangerous in various area's due to what it had done.

    Worried that coPilot will replicate that on someones health record and the consequences will be a little worse than a comment

    1. Aladdin Sane Silver badge

      Re: Worring times

      Summarised letter to patient:

      You will probably not die.

      1. TReko

        Re: Worring times

        Real summarised letter to patient:

        AI: "You're absolutely right -- my mistake -- I prescribed 10x the dosage of Morphine. Please take 1mg instead, if you are still alive.

        Is there anything else I can help with today?"

    2. elsergiovolador Silver badge

      Re: Worring times

      Maybe that's one way to reduce waitlists - get patients to die.

      1. SomeRandom1
        Pirate

        Re: Worring times

        That's the British government plan: have the proles pay all their taxes, save for the future and then die before they can claim them.

      2. Anonymous Coward
        Anonymous Coward

        Re: Worring times

        It’s worked so far.

      3. Ian Johnston Silver badge

        Re: Worring times

        That has always been the policy in some areas, like hip replacements, where longer waiting times significantly reduce the number of operations which need done.

  3. elsergiovolador Silver badge

    National Humiliation Service

    NHS England has announced that it will hand Microsoft 365 Copilot to 505,000 staff, on the strength of a pilot that "found" each user saved 43 minutes a day. That figure is self-reported, gathered under trial conditions, and will not survive contact with half a million live workflows. It is the kind of number that exists to be quoted, not tested.

    Set it aside, because the more revealing admission is structural. The tasks Copilot is being bought to absorb are discharge paperwork, bed management, rota planning, board papers, briefings, FOI handling, complaints, procurement and finance. None of that is frontier work. It is the basic operational competence of a back office. When an organisation outsources its own paperwork to a vendor's language model, it is conceding that the people employed to design and run those processes have not managed to. Administrative dysfunction is being procured around rather than fixed.

    Now consider where the data goes. Microsoft is a US company, and US companies fall under the CLOUD Act, which compels them to produce data on demand from American authorities regardless of which country it physically sits in. Microsoft has already admitted, in writing to Scottish policing bodies, that it cannot guarantee data sovereignty for M365. So some of the most sensitive personal information that exists, the medical records of the population, is being routed through infrastructure a foreign government can reach by court order, with no obligation to tell the patient or the UK.

    It gets worse when you look at who is being paid. Microsoft books returns of three to four per cent in the UK while channelling the overwhelming majority of its foreign income through Ireland, Puerto Rico and Bermuda, structures analysts have described as starving the public sector of revenue. The British taxpayer is therefore funding, at a scale that runs well into nine figures a year, a contractor that goes to considerable lengths to avoid paying tax into the very services it is billing. Public money out, very little back.

    And once again a public body has reached for a US giant rather than build or buy domestic capability. Every contract of this size is a quiet vote of no confidence in British industry, and in the government's own sovereign-AI rhetoric, which evaporates the moment a procurement form lands in front of someone.

    Then there is the product itself. Copilot is not best in class. It hallucinates, it stalls mid-task, and Microsoft has been publicly scaling back its consumer ambitions for it. Drop that into a clinical environment, where a confident fabrication in a discharge summary, a handover note or a medication record becomes a vector for harm. Avoidable injury and death in healthcare are overwhelmingly driven by failures of communication and information. Introducing a system that invents plausible text into exactly those documents is a remarkable thing to call a safety improvement.

    Microsoft's own terms of use, until they went viral, described Copilot as being "for entertainment purposes only" and told users not to rely on it for important advice. The company rebranded that as "legacy language" only after it was noticed. The vendor's own lawyers would not stand behind the product. NHS England is staking patient care on it.

    1. Doctor Syntax Silver badge

      Re: National Humiliation Service

      a pilot that "found" each user saved 43 minutes a day

      We can only hope that this doesn't become the basis for clinical trials.

    2. Anonymous Coward
      Anonymous Coward

      Re: National Humiliation Service

      "So some of the most sensitive personal information that exists, the medical records of the population, is being routed through infrastructure a foreign government can reach by court order, with no obligation to tell the patient or the UK."

      EMIS is one of the main providers (2nd largest?) of electronic medical records systems for English GP Practices. EMIS originally used to host that data in its own UK datacentres but several years ago moved to AWS instead. So already for some time the (GP) medical records of a large percentage of the English population havebeen "routed through infrastructure a foreign government can reach by court order".

    3. tin 2

      Re: National Humiliation Service

      "it is conceding that the people employed to design and run those processes have not managed to. Administrative dysfunction is being procured around rather than fixed."

      For me that's the stand out key point.

      Some £, time and decent people invested in some competant systems that (a) eliminate admin (b) do some of the admin or (c) help make the admin much quicker will produce a much greater ROI in time and £ than is being talked about here

      But that's boring, not at all sexy, and those in charge often are unable to see the wood for the trees.

      Time for some extremely strong leadership in the real of boring admin!

      1. munnoch Silver badge

        Re: National Humiliation Service

        Bed management.

        That's an optimisation problem, right? Which is a numerically hard problem to solve well never mind perfectly.

        With LLM's being staggeringly bad (even relative to their usual level of performance) at anything numerate how could you have any expectation of an improved outcome?

        So far as the rest, ML models need good patterns as input in order to produce good output. If the input is nothing but dysfunction then what do you suppose you get out?

        1. Pirate Peter

          Re: National Humiliation Service

          that a long winded way of saying

          "shit in = shit out"

          :)

        2. Pen-y-gors

          Re: National Humiliation Service

          Bed usage optimisation is now critical because of underfunding over decades

          A properly funded and managed system would have a capacity cushion built in to cope with peaks and troughs. Instead they deem it a failure if bed occupancy isn't at least 99.93% 24/7/365 - which is why we have waiting lists.

          When I was in hospital a couple of years back, there was an elderly gent on the ward waiting for a transfer to another hospital for a replacement heart valve. He was in generally good nick, spent the days reading and walking the corridors. They kept giving him a date, then cancelling due to an emergency coming in to the other hospital - or lack of transport for the 100 mile journey. He was taking up a bed in our cardiac unit for nearly three weeks before he finally went.

  4. Anonymous Coward
    Anonymous Coward

    What a scam. Follow the money.

  5. midgepad Bronze badge

    oh

    dear!

  6. Doctor Syntax Silver badge

    It sounds like a case of "Here's a straw, let's grasp it", a variation on the politician's syllogism.

    Perhaps it would have been better to have submitted the plan to NICE prior to approval.

    1. elsergiovolador Silver badge

      Even better plan would be to invest money in medical staff and try to reverse the brain drain.

      1. SomeRandom1
        Joke

        Gasp

        Get out of here, we cannot have sensible thinking in the UK!

      2. Phil O'Sophical Silver badge

        Never mind medical staff, they could save users more than "an average of 43 minutes a day on admin" by hiring some admin staff (secretaries for the non-PC) so that medical staff could concentrate on the part of their jobs which really matters.

  7. sarusa Silver badge
    Devil

    Oh dear

    > after a pilot claimed the AI assistant could claw back 43 minutes a day from administrative work.

    Well yes, if you don't care if the output is correct at all you can save a lot of time. Thank heavens the NHS does not!

    Which is further made obvious by their picking worst in class AI Copilot* for this.

    * Okay, it shares that throne with Grok

  8. John 110
    Coat

    Meeting minutes

    Meeting minutes seems a good fit. The minutes of most of the meetings I attended (when I still worked) read like hallucinations anyway.

    I'll get me labcoat...

  9. JLV Silver badge
    Trollface

    Tokenmaxxing?

    April 2nd, 2027

    “ Regrettably, NHS has burned through its IT and token allotment for this budget year. All staff are henceforth directed to pencil and paper, supplemented by abaci”.

  10. Flocke Kroes Silver badge

    In one ear...

    IIRC copilot interactions are used as training data. If you can guess a piece of someones records copilot may well tell you what comes next / before.

    Agentic AI handling complaints: "You have the wrong bank details for my salary", "You can settle out of court for £5,000", ...

    1. gryphon

      Re: In one ear...

      Well they pinky promise not to use Copilot Business for training the LLM models and that Copilot data will now be processed within the UK.

      Which is obviously enough for whoever signs off on data leakage risks for the NHS.

  11. Anonymous Coward
    Anonymous Coward

    I’m not dead yet!

    I’m feeling much better….

  12. Cruachan Silver badge

    How many of those "saved" 43 minutes were not having to deal with "Copilot can help you with that. Would you like to install it?" prompts?

  13. Anonymous Coward
    Anonymous Coward

    I struggle to get NHS staff to send us screenshots without using their mobile...

    How many managers are now going to call themselves "AI Integrators" and demand more money to do less?

    ^sigh^

  14. pacharanero

    Because Big Tech is more important than the NHS's actual staff

    NHSE's 'technology' (read: bullshit) spending is totally out of control.

    They are rapidly approaching a point that there will be a 14-day wait to get an AI response from the NHS App, and no staff will be working in the NHS because they'll all have been made redundant, or left for the private sector in disgust.

    NHSE's absolute contempt for its staff, coupled with its total capture by Big Tech, has never been more apparent.

  15. Pen-y-gors

    Template engine?

    If it's used as a sophisticated template engine, fine.

    If it tries to summarise/deduce/extrapolate people will die.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon