The Register Home Page

back to article Connecting AI agents to outside services explodes the risk radius

Avoiding the "lethal trifecta" – access to private data, exposure to untrusted content, and an external communication path – is difficult enough when working with AI agents. But the use of connectors – integrations with third-party services like Gmail or Slack – expands the scope of concern in a way that makes it exceedingly …

  1. Wiretrip Bronze badge

    It is almost like the people developing all this shit have not even been around for the last 40 years of software development. The Dunning Kruger effect is spinning out of control in Silicon Valley.

    1. jake Silver badge

      For "people", read "kids".

      They haven't been around for 40 years. In fact, most of them do not remember a world without iPhones.

      To them, computers are black boxes that they are incapable of understanding the inner workings of, either by personal choice, or by corporate decree.

      It's all nothing more than magic to the poor, uncomprehending saps. They both don't know, and don't WANT to know, because that might be dangerous. And hard.

      I fear we are losing something very important that is going to prove to be almost impossible to get back. The hackishness that drove the early industry is being eradicated.

      1. Jou (Mxyzptlk) Silver badge

        Re: For "people", read "kids".

        iphones? I'm seeing the first generation of trainees who don't know "The Matrix"... Which means they haven't seen it three years later on (by the time still) linear TV as well...

        1. jake Silver badge

          Re: For "people", read "kids".

          Well, that's OK. That's just a movie and has nothing to do with reality.

        2. Doctor Syntax Silver badge

          Re: For "people", read "kids".

          Don't overlook the fact that there are people who were trainees before it* existed so couldn't know it.

          * I gather it's some sort of science fiction film. I can't be bothered with science fiction - so have survived an entire working life and a lot of retirement without knowing it. A Jake said, it has nothing to do with reality.

          1. Philo T Farnsworth Silver badge

            Re: For "people", read "kids".

            Even though I've long since outgrown the stuff1 I don't discount it.

            Far too many AI and crypto bros seem to think it's some sort of blueprint for the future, especially if you extend the reach of the genre into sword and sorcery fantasy.

            Witness all the ventures named after Lord of the Rings characters and talismans. I suspect Tolkein would be simultaneously amused and horrified that his little experiment in philology wrapped in an Aurthurian-adjacent2 fairy tale has spawned such unremitting awfulness (I'm talkin' to you, Peter Thiel).

            ________________

            1 As someone said, the golden age of science fiction is between 12 and 15.

            2 Where do you think Gandalf came from?

            1. jake Silver badge

              Re: For "people", read "kids".

              Naming boxen after Tolkien characters officially became old after I ran across the fifth server named "Bilbo" in a single day (two at Berkeley, one each at Stanford, San Jose State and Mission College). That was in roughly 1980.

              Gandalf made PABXs, line-drivers, terminal host selectors & the like starting in the very early '70s ... I assumed they got their name from the books, but dunno for sure.

              1. jake Silver badge

                Re: For "people", read "kids".

                Woops ...

                Make that PACX ... "Computer".

                Typo or brain fart? You decide. Take your time, no hurry, have a beer.

    2. itscomplicated

      To be fair, for most of that time software has been deterministic. If you want to limit an API's blast radius you either ensure the calling code doesn't do bad things (from the caller side) or establish permissions on the credential (from the service side)

      Neither of those are really viable when you want a (effectively) non-deterministic software system to take action on your behalf automatically. You can't control exactly what it will do and if you lock down the credential too much it won't be able to do what you want. So what do you do? Human-authorize each call? Write some heuristic to monitor the calls? Allow the bad things but have rollback functionality?

      It's still being worked on.

      1. jake Silver badge

        Well, what I do ...

        ... is not to use, nor recommend, installing options that increase the size, scope and number of potential attack vectors.

        Might as well go back to installing guest accounts with root access on every computer and be done with it.

        1. Anonymous Coward
          Anonymous Coward

          Re: Well, what I do ...

          Already done. It's called copilot.

          1. ecofeco Silver badge

            Re: Well, what I do ...

            Beat me to it.

            Already. Done.

      2. Richard 12 Silver badge

        LLM agents cannot be secured

        Not even in theory.

        All the security work that's been done is continuing to prove that, over and over again.

  2. steelpillow Silver badge
    Facepalm

    Well, slap me round the face with a wet kipper, who'd 'a thunk it!!!

    1. jake Silver badge

      A wet smoke cured fish? You're doing something wrong ...

      1. DoctorNine Silver badge

        What he does with his kippers in the privacy of his own domicile is of course his own affair. Let's not be too quick to judge.

        https://loiselsden.com/2014/02/26/slapped-round-the-face-with-a-wet-fish/

        1. jake Silver badge
          Pint

          I'm fairly certain a small village of Gauls was doing something similar around the time of Ceasar ... but they used fresh fish, not cured fish, as the preserved stuff was coin of the realm at the time. Still is, come to think of it ... Have you SEEN the price of kippers (or baklava or smoked salmon or katsuobushi) recently?

          With that said, I wasn't intending to kink-shame. Apologies if I did. Beers all around.

        2. steelpillow Silver badge

          @DoctorNine, how could you!

          > The slapper was a teen-age girl...

    2. ecofeco Silver badge

      "Smoke me a kipper, I'll be back for breakfast."

    3. steelpillow Silver badge

      When it is administered, I am always grateful that I am not standing beside a canal lock.

      1. David 132 Silver badge
        Thumb Up

        Teddington Lock, I believe.

        Pronounced "Throatwarbler-Mangrove".

  3. jake Silver badge

    One word:

    DUH!

  4. Tron Silver badge

    Luckily there is no legal requirement to...

    ....leave your doors and windows open at night, get blind drunk and fall asleep in a doorway with a wallet full of cash and cards, or use AI.

    Nor do we have to worry about people who choose to do so.

  5. Snowy Silver badge
    Holmes

    A problem before you included AI Agents.

    Connecting to outside services explodes the risk radius

    No need to include AI Agent for it to be a problem.

  6. ecofeco Silver badge
    Facepalm

    Another great moment in DUH!

    WHOCOULDAKNOWED?!

  7. Will Godfrey Silver badge
    Facepalm

    Obvious is obvious.

    Who knew?

  8. Bebu sa Ware Silver badge
    Facepalm

    "Oh, what a tangled web we weave, when first we practise to deceive!"

    That tale ends on Flodden Field.

    This nonsense might ultimately entail a much bigger catastrophe.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon