back to article If someone weaponizes our robots, we'll be really, really sad, says Boston Dynamics

Boston Dynamics and five other robot makers have promised in an open letter they won't allow their machines to be weaponized by either themselves or their customers.  Yes, never mind robotics corporations tooling up their equipment for militaries and other organizations, some people are trying to modify commercial robots by …

  1. veti Silver badge

    It won't start with weapons...

    First, the military will want robots to, e.g., clear mines and defuse bombs and secure hazardous environments. Good, humanitarian applications we can all get behind.

    Then they'll be drafted into reconnaissance and spying roles. At this point they'll probably have an explosive charge embedded so that they can self-destruct if captured and autopsied.

    By this time the military will know enough about them to make modifications without the manufacturer's support. Before long they'll be on sentry duty, if not actually carrying guns then certainly connected to the controls of a nearby turret.

    When you're in a war, not using your best resources is just stupid.

    1. Anonymous Coward
      Anonymous Coward

      Re: It won't start with weapons...

      I recognize something my teacher called 'future simple'. Tense, but what you describe is present. Present perfect. Continuous.

    2. The Man Who Fell To Earth Silver badge
      FAIL

      Re: It won't start with weapons...

      The pledge isn't worth the paper it's printed on. If Boston Dynamics changes owners yet again, it will depend on the new owners.

      1. Anonymous Coward
        Anonymous Coward

        Boston (Marketing) Dynamics

        This is a whole bunch of marketing bullshit that's equivalent to Google's "Do No Evil" bullshit marketing. Boston Dynamics will be the first company to develop a Cobalt-59 Doggy Bag nuke.

        1. EVP
          Terminator

          Re: Boston (Marketing) Dynamics

          Fixed the headline:

          "If someone weaponizes our robots without paying a license fee, we'll be really, really sad, says Boston Dynamics"

  2. Anonymous Coward
    Anonymous Coward

    Bad actors

    "And that means we need policy that prohibits bad actors from misusing it."

    Steven Seagal is abusing a robot?

    1. MiguelC Silver badge
      1. SotarrTheWizard
        Trollface

        Re: Bad actors

        Ah. . .. but will it protect us from, say at least William Shatner ???

        1. The Oncoming Scorn Silver badge
          Terminator

          Re: Bad actors

          He will teach it this thing from our world called a kiss.

          Damn no Paris,

    2. EVP

      Re: Bad actors

      "Steven Seagal is abusing a robot?"

      Is Steven Seagal an abusing robot?

      1. Psmo

        Re: Bad actors

        Certainly not an amusing robot.

  3. Anonymous Coward
    Anonymous Coward

    It's really not that hard to evolve control systems for robots using nature inspired methods. Simulate a few thousand robots for a few thousand 'years' on a supercomputer and you'll end up with an analogue of natural evolution, and can then just transfer that neural net to the real thing in the physical world. I expect there to be military drones/robots in the open literature very soon, ornithopters that fly just like real birds, can find thermals, swoop and soar, and have GUNS in their beaks and know what to fire at thanks to a thousand years of reinforcement learning :D

    Or maybe we'll make insects, a few grams each, with nerve agent tipped stingers. And mass produce millions of them to drop over an enemy.

    1. SloppyJesse

      > a few thousand 'years'

      Might need a little longer than that.

    2. EVP
      Terminator

      Good point. Why don't we just simulate politicians to get politician robots? Moreover, we can manufacture only robot politician heads, since most of the politicians are just talking heads anyway. Cheaper, and we can put them in a special soundproofed container where they can argue with each other as much as they like.

      1. veti Silver badge

        How would that help? It's a lot of work to reproduce what we've already got.

  4. DS999 Silver badge

    They could probably detect use of firearms

    The recoil from a gun is a pretty significant and sudden acceleration that would be unlike other types of acceleration that might occur from e.g. getting bumped, having something thrown at it, etc.

    They could probably train their robot's AI to detect it, and if detected shut down and require a manual reset. That would make it useless to use it in a scenario where it may need to fire a weapon, other than where it would only need to fire one shot before being manually retrieved.

    1. Securitymoose
      Black Helicopters

      Re: They could probably detect use of firearms

      Fitted lasers wouldn't have a recoil. Getting very sci-fi now!

      1. Prst. V.Jeltz Silver badge

        Re: They could probably detect use of firearms

        you mean frickin lasers surely?

        1. DubyaG
          Childcatcher

          Re: They could probably detect use of firearms

          But, but, but, think about the sharks!

    2. theOtherJT Silver badge

      Re: They could probably detect use of firearms

      Rocket launchers and flame throwers it is then...

      1. Fruit and Nutcase Silver badge

        Re: They could probably detect use of firearms

        Musk is developing a humanoid robot. He's already marketed a flamethrower.

    3. Prst. V.Jeltz Silver badge

      Re: They could probably detect use of firearms

      The recoil from a gun is a pretty significant .... train their robot's AI to detect it,

      Thats sounds like a really minor issue compared to the tech they've achieved in these robots .

      Guns can be made recoil less (like a Bren gun ) , and they wouldnt need to *detect* the recoil - they know when they've pulled the trigger!

      "recoil" from incoming fire might be harder to deal with - but perhaps theyd be better getting knocked on their shiny metal asses in that case so as to take immediate cover !

      1. DS999 Silver badge

        Re: They could probably detect use of firearms

        All it knows is it moved a "finger". It has no concept of what the result of that is supposed to be, or that it is holding a firearm versus any of a billion other objects it could be grasping.

        1. Trixr

          Re: They could probably detect use of firearms

          Exactly, and it doesn't event need to be a limb that's "holding" a weapon. A mount on the chassis with some kind of switch for a trigger. Just like weapons mounted on planes, ships etc. The recoil idea is pretty good.

      2. WolfFan Silver badge

        Re: They could probably detect use of firearms

        Speaking as someone who has fired a Bren gun, I can say that it is most definitely not recoiless.

    4. DJO Silver badge

      Re: They could probably detect use of firearms

      ...recoil from a gun is a pretty significant...probably train their robot's AI to detect it...

      That won't stop them from being used to lay mines or used as suicide bombs or dozens of other offensive roles.

      The main problem is battery life, most uses need an umbilical for command and power - all the manufacturers of robots seem a bit coy about autonomous operation.

      1. DS999 Silver badge
        Trollface

        Re: They could probably detect use of firearms

        Well if you're OK with it moving very slowly it could be solar powered!

        1. The Oncoming Scorn Silver badge
          Holmes

          Re: They could probably detect use of firearms

          Not so good for covert night operations then.

  5. The commentard formerly known as Mister_C Silver badge
    Trollface

    Just team up with John Deere

    They seem to have preventing user modifications sussed.

    1. Yet Another Anonymous coward Silver badge

      Re: Just team up with John Deere

      Except for Ukrainians

  6. Richard 12 Silver badge

    DARPA funded, though

    Which implies the statements are likely to be empty.

    1. Anonymous Coward
      Anonymous Coward

      Re: DARPA funded, though

      could also be taken as a bit sinister:

      "To be clear, we are not taking issue with existing technologies that nations and their government agencies use to defend themselves and uphold their laws."

      The tinfoil hat says Government will always get the un-patched firmware...

      1. Anonymous Coward
        Anonymous Coward

        Re: DARPA funded, though

        The new Punisher2000 (with umlaut) - exterminates protesters while leaving your voters unharmed

  7. Khaptain Silver badge

    Aren't Drones just simple robots ?

    It's already being done.

    And wheres the proof that BD is not already being actively encouraged to share with the military. Who else has the budget or requirement for the kind 9f Robots that they are producing?

    1. Trixr

      Re: Aren't Drones just simple robots ?

      Yes, the message I was getting loud and strong was that "bad actors" is probably not going to apply to any country's duly-appointed military. Maybe not even to military forces engaged by the "right" nationstates - mercs, sorry, "contractors", are hired by various governments all the time.

      And that wasn't the only prevaricating phrase in that statement.

  8. Disgusted Of Tunbridge Wells Silver badge
    Facepalm

    I'm sure Chinese companies will ( be allowed to ) have the same policy...

    1. Yet Another Anonymous coward Silver badge

      If we could only get the Chinese to spend all their R&D money and science/engineering talent on increasingly complex and expensive weapons systems we could bring down their whole system.

      It worked for the USA.

      1. Peter2 Silver badge

        If we could only get the Chinese to spend all their R&D money and science/engineering talent on increasingly complex and expensive weapons systems we could bring down their whole system.

        Congratulations; you've successfully described the Strategy of Technology. which used to be a military textbook.

        "A gigantic technological race is in progress between interception and penetration and each time capacity for interception makes progress it is answered by a new advance in capacity for penetration. Thus a new form of strategy is developing in peacetime, a strategy of which the phrase ‘arms race’ used prior to the old great conflicts is hardly more than a faint reflection.

        There are no battles in this strategy; each side is merely trying to outdo in performance the equipment of the other. It has been termed ‘logistic strategy’. Its tactics are industrial, technical, and financial. It is a form of indirect attrition; instead of destroying enemy resources, its object is to make them obsolete, thereby forcing on him an enormous expenditure….

        A silent and apparently peaceful war is therefore in progress, but it could well be a war which of itself could be decisive."

        --General d’Armee Andre Beaufre

        And anybody denying that technological war works needs to take a good hard look at Ukraine. The Russians dropped out, and ended up so far behind that their equipment wasn't capable of competing with western weapon systems. (Which to be fair, they didn't expect to encounter)

        As a result of which, light anti tank weapons were able to blow up soviet battletanks.

        Shoulder launched SAM's cleared the sky of aircraft and helicopters.

        Cheapish anti RADAR missiles destroyed Russian Surface to Air Missile batteries, allowing their army to be bombed from the air with impunity.

        Russian Infantry found that their rifle bullets didn't reliably penetrate the modern body armour that the Ukrainians were gifted.

        China might well be interested in competing, but they can't do so against the combined Military R&D of every other country in the world, and I suspect that they know it. North Korea and Iran have seen what happens when massed collections of outdated equipment clash with a small subset of modern military technology countries were willing to share with Ukraine, and will realise that they haven't even been given a lot of our heavy equipment because we don't want to show what it can actually do. I think they'll have lost any appetite for foreign adventures that they might have had.

        And so after Russia finally accepts that they have lost in Ukraine and gets out, we can say welcome to the Pax Technologia.

  9. Brewster's Angle Grinder Silver badge

    They already have the second law sussed; now we need the first law.

    "They go where they are told, and they hit who they're told to hit."

    It's not beyond the bounds of programming for an AI to recognise a human and refuse to hit it. Okay, some days it'll mistake the human for a bicycle. But if it stops it most of the time, that's a win. It could be law 1, part 1, "A robot may not injure a human being..."

    And it will be hard to hack if it's fundamental part of the model that does collision avoidance and motion control.

    1. Anonymous Coward
      Anonymous Coward

      @Brewster's Angle Grinder - Re: They already have the second law sussed; now we need the first law.

      Why bother ? The AI will signal that it recognized a human then the hitting will be delegated to a secondary less-intelligent system which will take action based on this signal. Problem solved!

    2. Ideasource Bronze badge

      Re: They already have the second law sussed; now we need the first law.

      Wouldn't have to hack the whole thing. I'd probably use augmented reality "slipons" to sensors. These slipons would sample the surrounding environment and render and output a modified sensor scene to the existing hardware through analog means.

  10. x 7

    Aren't there some laws built into robots to make them safe? Three from memory?

    1. MiguelC Silver badge

      In fiction there are, in reality no. And in any case AI is still quite a long way away from even enabling those laws to be accurately programmed into their robotic 'minds'

    2. Anonymous Coward
      Anonymous Coward

      @x 7 - Just try to Google

      "why the three laws of robots will not work"

  11. karlkarl Silver badge

    Still no unfortunately

    "Maybe finally a good use for DRM, eh? Preventing armed modifications"

    The sort of criminals who are going to weaponise the robots against the terms of license are the sorts who can crack DRM in a matter of minutes.

    So again, just like everything else; the DRM will only hurt us little guys who want to use the robot to waddle around their garden cleaning up dog turd.

    1. MachDiamond Silver badge

      Re: Still no unfortunately

      "The sort of criminals who are going to weaponise the robots against the terms of license are the sorts who can crack DRM in a matter of minutes."

      They are also closely aligned with the group that can pass a law that says they don't have to abide by any DRM protections in their case.

  12. Anonymous Coward
    Anonymous Coward

    The idea is to prevent commercial drones being militarised so that they can charge the government more money for the special military drones.

    1. Yet Another Anonymous coward Silver badge

      Ironically being demonstrated in the country famed for its DRM defeating tractor firmware hacks

  13. Plest Silver badge
    Terminator

    ED-209

    ED-209 : Put down your weapon. You have twenty seconds to comply.

    ED-209 : You now have fifteen seconds to comply.

    ED-209 : You are in violation of Penal Code 13, Section 5

    ED-209 : You have five seconds to comply.

    ED-209 : Three... two... one... I am authorized to use force!

  14. SotarrTheWizard

    First Rule of Security. . .

    . . . .if your "Bad Actor" has physical access to the tech, they **will** find a way to exploit and modify it. . .

  15. cawfee
    Terminator

    this is 100% in relation to this video by youtuber "I did a thing"...

    bored Australians seem to work faster than any military

  16. Meeker Morgan

    For generations, Man has dreamed of killer robots. Now that great dream is about to be realized.

    If it hasn't already. All we know for sure is there have been no large deployments.

    1. Anonymous Coward
      Anonymous Coward

      Re: For generations, Man has dreamed of killer robots. Now that great dream is about to be realized.

      Winged beasts flying through the air to pinpoint locations able to vaporize people/buildings/cit-blocks/cities in a flash. Those are already old hat.

  17. Evil Auditor Silver badge

    «Sad» as in: let's celebrate our prospective increase in profit?

  18. Anonymous Coward
    Anonymous Coward

    No sweat

    We still have Bruce WIllis to protect us from meteors, and Peter Weller to protect us from weapon-enhanced robots. I think we're OK.

  19. trevorde Silver badge

    Elephant in the room

    What about pr0n?

  20. BebopWeBop

    If someone weaponizes our robots, we'll be really, really sad, says Boston Dynamics

    But if we see the profits rolling in....

  21. steviebuk Silver badge

    Too late

    Just look it up as was recently on display at a Russian arms trade show. The Chinese knock off of their dog with a bazooka attached to its back. So too late Boston Dynamics.

    1. Anonymous Coward
      Anonymous Coward

      @steviebuk - Re: Too late

      Why look so far from home ? They are not the only one having a military-industrial complex. And they are not the best at it.

      1. steviebuk Silver badge

        Re: @steviebuk - Too late

        Cause it was about Boston Dynamics. Only place I've seen it used, yes its a knock off from the Chinese but its still their design.

  22. Anonymous Coward
    Anonymous Coward

    Automated targeting and killing is a Nirvana

    AI autonomous targeting and killing is a Nirvana for any military, TLA or law enforcement of any country. It allows to dodge responsibility for any collateral death of innocent people. As an added bonus, it can even offer plausible deniability by blaming a bug in the algorithms.

    1. Anonymous Coward
      Anonymous Coward

      Re: Automated targeting and killing is a Nirvana

      On the other hand, let's say a robot rolls or walks up to a car stopped for speeding or some violation, to request a drivers license. There is no excuse for the robot to blow away the driver because it mistakenly thought the driver's cell phone was a gun. A robot should not get "qualified immunity", because it is not alive. Or, if the driver is desperate and violent, and shoots the robot in anger, no big loss and an officers life is saved.

      Take the example of cameras used to track vehicles and people - so many in the UK. They can be used for used for good or bad purposes - or both. In the murder of Sarah Everard, they provided concise and immediate data to identify her murderer, who was a police officer. One can imagine a different society where that information was hidden from the public so the police force could avoid a scandal. But that's not what happened in our present reality.

  23. M.V. Lipvig Silver badge
    Joke

    None of this ever occurred to me

    until I read the letter. Now, I can see robots patrolling my compound 24x7 (as all we USAians have compounds) armed with twin drum-fed AK47s (as we also have tons of excess firearms just laying about) mounted to each arm. And, they'll be programmed to deal with the neighbor's schnauzer the next time it lifts a leg on my petunias!

  24. MachDiamond Silver badge

    A company missing

    Foster-Miller doesn't seem to be a signatory and their lineup is principally robots for warfare/military.

    There are a whole bunch of military applications that don't involve firing a weapon at the enemy. They can sweep for IED's. Plant IED's, mines and move munitions to forward positions. They can move to strategic locations and provide surveillance, comms relays and act as a differential GPS points for precision guided munition delivery. The list goes on and on. I can envision a robot dog that has a detector to navigate a mine field and work it's way into the middle where it can sit in a protected position and do a job using the enemy's mines that they know are planted in that field so aren't going to close in to destroy the robot and the robot can have mapped out a way to make a rapid retreat if needed.

    1. Fruit and Nutcase Silver badge

      Re: A company missing

      Tesla with their Optimus?

      I know, with Musk, better to wait till something is in production...

  25. Withdrawn

    Just a bit of fine print

    "widely available to the public"

  26. Fruit and Nutcase Silver badge
    Alert

    Cry

    Military: Cry havoc, and let slip the [robot] dogs of war

    Boston Dynamics: Cry

    With thanks to William Shakespeare

  27. spold Silver badge
    Alert

    But....

    "We pledge that we will not weaponize our advanced-mobility general-purpose robots or the software we develop that enables advanced robotics and we will not support others to do so"

    ...does this include the robots themselves?

  28. Chris Stephens

    Uhhhhh.... DARPA funded.. Ummmm... Didn't they already sell their soul ?

    https://www.darpa.mil/about-us/timeline/debut-atlas-robot

  29. An_Old_Dog Silver badge
    Gimp

    Oh, But You Misunderstand

    They don't want to stop their robots from being weaponized.

    They simply want to appear want to stop their robots from being weaponized. It's business-as-usual. Does anyone seriously think a "policy" which states, "you may not arm our robots" will be worth a tinker's damn?

    A more-accurate official statement would be, "We do not sell weaponized robots. Cough (but we do sell our robots to OEMs, who arm them and resell them to military and police organizations. And business is booming!) cough."

    1. martinusher Silver badge

      Re: Oh, But You Misunderstand

      The only thing that's preventing them from being weaponized is that nobody quite knows the optimum shape or mounting for a weapon. Yet.

      Every other technology has been weaponized. This will be, too. Boston Dynamics might be sad but their shareholders won't be.

      The future is already here:-

      https://www.msn.com/en-gb/news/world/israel-pilots-robotic-machine-gun-at-west-bank-checkpoint/ar-AA12fWgG

  30. ScottishYorkshireMan

    We learn..

    We learn what powers the sun, and make bombs from it. - John Morlar.

    As will be the same with robots. We will learn how to make them make war.

  31. Shalghar

    How will they prevent piggyback murders ?

    So lets say the integrity of those robots stays intact. No harm done in sending them to some place, right ?

    But what about a completely independant payload strapped to their chassis ? Something like a bomb, a nerve gas dispenser, anything incindiery that can be triggered without the robots hardware being connected to it ?

    Add any trigger you want to that payload weapon, be it facial precognition or other insecure measures, be it GPS/location triggers, the traditional time bomb, temperature or motion detection triggers or a mix of everything able to pull the pin.

    I believe its pretty much impossible to avoid such scenarios, that is if anyone (including the robot corporations) cares at all.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like