back to article San Francisco politicians to vote on policy endorsing lethal force for robots

Next week, the San Francisco Board of Supervisors is expected to vote on a policy proposal that will allow the San Francisco Police Department (SFPD) to deploy robots authorized to kill people. No such use is currently planned, according to SFPD, which characterized the policy proposal as an endorsement of the continued use of …

  1. Sora2566 Bronze badge

    I really wish people would stop referring to machines controlled directly by humans as "robots". That's not what the word means.

    And if I am controlling a machine and the machine kills somebody, I should really hope that I would be held to account for the death.

    1. Harry Kiri

      Kill chain

      That's a good point, I don't know about the US but certainly the UK military requires a human in the loop for lethal actions.

      1. Strahd Ivarius Silver badge

        Re: Kill chain

        a human that is there to routinely approve any request that goes his way?

        1. Anonymous Coward
          Anonymous Coward

          Re: Kill chain

          Absolutely not. Despite what Call of Duty might have you think there is a strict legal framework for lethal engagement. Step outside of that and there's a whole lot of trouble and no legal protection.

          1. stiine Silver badge
            Mushroom

            Re: Kill chain

            Who needs legal protection when you have additional B61s?

          2. Anonymous Coward
            Anonymous Coward

            @AC - Re: Kill chain

            Killing robots are completely outside the legal framework. And many stakeholders are working hard to remain like that.

            1. Anonymous Coward
              Anonymous Coward

              Re: @AC - Kill chain

              They might be where you are but not in the UK. There is liability but its a fight as to whose. This is the same philosophical argument that has been going on for a long time regarding self-driving cars and another example of the trolley problem (https://en.wikipedia.org/wiki/Trolley_problem).

    2. Anonymous Coward
      Anonymous Coward

      Tell that to Omnicorp.

    3. DS999 Silver badge
      Terminator

      Yep, basically a gun with a remote control trigger. When you read about "robots with lethal force" it immediately brings this icon to mind!

    4. trindflo Bronze badge
      Headmaster

      Machines controlled directly by humans

      You may be right that "robot" conveys a notion of an autonomous robot to some people, but robots can be autonomous or semi-autonomous. Lethal Autonomous Weapons (LAWs) are robots, but not all robots are LAWs.

      I think the term robot is being used properly here, and the general public will eventually get beyond science fiction notions of robots as only autonomous AI-driven androids.

      1. Anonymous Coward
        Anonymous Coward

        Re: Machines controlled directly by humans

        Aren't LAWs Light Anti-armour Weapons?

        1. trindflo Bronze badge

          Re: Machines controlled directly by humans

          Aren't LAWs Light Anti-armour Weapons?
          Maybe?

          The acronym I was looking for was LAWS and not LAWs and is correctly "lethal autonomous weapons systems". Thanks for the correction.

          From Wikipedia: Military Robot

      2. Anonymous Coward
        Anonymous Coward

        Re: Machines controlled directly by humans

        Robot has been corrupted by idiots to mean remote controlled toy.

        Robot's are autonomous.

        1. AMBxx Silver badge

          Re: Machines controlled directly by humans

          The original traffic lights were called Robots, still are in South Africa.

        2. trindflo Bronze badge

          Re: Machines controlled directly by humans

          Robot has been corrupted by idiots to mean remote controlled toy.

          If you are including industrial robots in your definitions of corrupted, idiots, and toys then you are at odds with the modern world. Words evolve. I would be interested to see a modern credible source for a definition of robot that requires it to be fully autonomous (without alternative definitions for partially autonomous robots).

      3. Strahd Ivarius Silver badge
        Coat

        Re: Machines controlled directly by humans

        what about the Judge?

    5. Fr. Ted Crilly Silver badge

      'Waldo' is the word you are after.

      1. Anonymous Coward
        Anonymous Coward

        Not (Call Me) Kenneth ?

      2. Strahd Ivarius Silver badge
        Joke

        Re:

        I was looking for it and didn't find it

    6. jmch Silver badge
      Facepalm

      Rather than the 'robot' part, I would be more worried about the 'military equipment' part. US police forces have become more and more militarised since 9/11, partly because of federal grants that can only be used for specific antiterror purposes. Grants which police departments prefer to use rather than lose, and then once they have the equipment it's a case of 'might as well use it since we have it'.

      That in turn is part of the escalation where both criminals and non-criminals have easy access to high-power weaponry and the police 'need' to militarise just to keep up. Which ends up in the type of scenarios seen in Robocop.

    7. An_Old_Dog Silver badge
      Headmaster

      Terminology

      The technically-correct term for a machine controlled directly by (a) human(s) is, "waldo."

  2. Lordrobot

    SFO Bums are very resiliant... Meet Ed209...

    People will scream "ain't it awful!" but Ed209 will restore the streets of San Francisco in a jiffy. Fair warning bums, Ed209 doesn't like harsh threatening language...

    "Bum, you have 20 seconds to comply... 15 seconds to comply... "

    1. chivo243 Silver badge
      Pint

      Re: SFO Bums are very resiliant... Meet Ed209...

      Obligatory for mentioning Ed209! Have an upvote and one of these --->

  3. Neil Barnes Silver badge
    Coat

    How can they possibly have a killer robot?

    Surely the three laws will operate to prevent that?

    Checking pocket for spare positronic brain --->

  4. Cynical Pie

    Is anyone checking to see if Elon is building Starlink or Skynet?

    1. Khaptain Silver badge

      Elon's not but the San Fransico Governer/Mayor has certainley considered it obviously.

      Never forget, Hollywood is a neighbour, and that they have seen the films and believed them....

      1. runt row raggy

        almost like London and Glasgow are neighbors. (similar distance).

        1. Khaptain Silver badge

          I drove from New York to San Diego when I was younger in a Honda Civic and then half way back again to Missisippi in a pickup truck.

          SF to Los Angeles is laughing material.

  5. Joe W Silver badge

    Weird...

    "The proposal addresses California Assembly Bill 481, which requires law enforcement agencies to obtain approval from an appropriate legislative body for the use of military equipment."

    Military equipment. For the plod.

    Next they'll get Reaper drones to patrol the streets, or ICBMs (ok, maybe not, as they aim outside of your jurisdiction).

    Weird place.

    1. Anonymous Coward
      Anonymous Coward

      Re: Weird...

      In my time, we call them hunter seekers. We only move at night because it's harder for them to spot us.

      1. chivo243 Silver badge
        Boffin

        Re: Weird...

        Not to worry Shadout Mapes, I was it's target, it only came to the motion...

    2. Spazturtle Silver badge

      Re: Weird...

      The US police don't really do what we in the UK would call policing, it is more like counter insurgency work. Americans are willing to start a gun fight and die over the smallest of things, you can find videos of people getting pulled over for having broken taillights and being given a fix-it ticket (so not even a fine) and deciding to pull out a gun and get themselves killed.

      1. oiseau
        WTF?

        Re: Weird...

        ... and deciding to pull out a gun and get themselves killed.

        Hmm ...

        Yes, bound to happen where to most anyone over 18 purchasing a Glock 22 is as easy and straightforward as just asking for one.

        But there have been many more situations where police pulled their guns and shot (rpeatedly) a pedestrian/driver because they had reached for something which ended up being nothing at all.

        Not to mention the infamous no-knock warrants, it is mind bending.

        Granted, most if not all affected were US citizens which were not pale enough to qualify as white.

        Maybe that should also be taken into account.

        Armed robots will only make it worse.

        O.

        1. John Brown (no body) Silver badge

          Re: Weird...

          "Armed robots will only make it worse."

          Yes, we all know the...difficulties...AI facial recognition has with people of a darker shade of pale.

        2. StudeJeff

          Re: Weird...

          It's not nearly as easy as you seem to think to get a handgun.

          Where I live in North Carolina the first step is to fill out a permit request with the country sheriffs office. They do a background check and if you pass it you will get a permit to purchase a pistol.

          That may take anywhere from a few days to a few weeks.

          Once you have your permit you can go to a dealer licensed by the federal government, and after showing your ID and permit you can buy a pistol.

          If you go through the much more rigorous process of getting a concealed carry permit, which costs several hundred dollars and you have to take classes it's much easier to get a handgun. You go into the gun store, show them your CCH (Concealed Carry Handgun), and your driver's license, then you can go ahead and purchase your gun.

          And yes, sadly there have been situations where someone has reached for something and gotten shot... but in a situation where say, you have been pulled over by an officer the LAST thing you want to do is something he sees as threating. He has no way of knowing if you are reaching for a gun or a pack of gum, and far too many police officers have died in just this kind of scenario, only the person they were dealing with DID reach for a gun.

          Another fact of the matter is white people are more likely to be shot by the police than blacks, and blacks are most likely to be shot by other blacks.

          1. oiseau
            Stop

            Re: Weird...

            ... not nearly as easy as you seem to think to get a handgun.

            Seems not.

            ... white people are more likely to be shot by the police than blacks ...

            Well ...

            Not according to The Washington Post in their (ongoing) seven year statistic (updated 21/11/2022):

            ---

            Black Americans are killed at a much higher rate than White Americans

            Although half of the people shot and killed by police are White, Black Americans are shot at a disproportionate rate. They account for less than 13 percent of the U.S. population, but are killed by police at more than twice the rate of White Americans. Hispanic Americans are also killed by police at a disproportionate rate.

            ---

            ie:

            - Black: 42 per million

            - Hispanic: 30 per million

            - White: 17 per million

            - Other: 5 per million

            As you will surely gather, White victims of police violence have been 17 per million while the rest ie: those not considered White by the police or the Washington Post, have been 77 per million.

            The victims are overwhelmingly young and male (>95%) and the shootings happen all across the US.

            That's over 4.5 times as many.

            Granted, the study is not making any distinction between Black or White police officers, but I doubt it is relevant in any way.

            Truly, a very sad state of affairs.

            O.

            1. This post has been deleted by its author

            2. Falmari Silver badge

              Re: Weird...

              I am not disagreeing with you initial figures just your concluding maths, over 4.5 times as many. You can't add the per millions together (42 + 30 + 5) and come up with 77 per million.

              Looking at the link non-white population 130 million 3177 of which were killed by police. So 24.4 per million non-white population not 77 per million.

  6. Securitymoose
    Big Brother

    It will come eventually

    It's all very well civilised nations doing the right thing, but how long before certain despot regimes are employing them to control the population with no restrictions? After all, Covid is getting to be a really lame excuse these days.

  7. OhForF' Silver badge

    Grant of unnecessary permissions?

    If No such use is currently planned, according to SFPD why is the department asking for permission for such use?

    Asking for unnecessary permissions is a red flag for me (usually triggered by applications on my smartphone and not police departments).

    Don't worry, we don't have any (current and publicly known) plans to exercise all those rights we ask you to grant us ...

    1. hayzoos

      Re: Grant of unnecessary permissions?

      Similar statements were made to objections of the expansion of authority and secret warrants and courts granted by the US Patriot Act passed after the 2001 September Eleventh attacks.

      Something along the lines of "Yes, it is broad overreach and possibly unconstitutional, but you can trust us, we wont go that far. And, TERRORISTS!"

      So where are the "robots" going to learn proper use of force from?

  8. chivo243 Silver badge

    Asimov or Herbert?

    Weren't the Butlerian Cymeks closer to the mark? Human mind controlling a machine?

  9. trindflo Bronze badge

    SFPD and the (sometimes radical) left-leaning San Francisco population and politics

    Not taking sides on this one, but I think the history is worth mentioning. Notable examples:

    Moscone/Milk Assassinations

    Symbionese Liberation Army

    There is probably more going on here than just a debate on what are the reasonable uses of technology.

  10. flayman Bronze badge

    Remote control is not a robot

    Others have already said this. Asimov should have nothing to add. A remote control device is not an AI. In legal and ethical terms, it should not be considered any different to driving or piloting a vehicle. It just happens to be capable of insulating the driver or pilot from any physical risks.

    1. trindflo Bronze badge
      Headmaster

      Re: Remote control is not a robot

      Strictly remote control (e.g. most publicly available drones) is not a robot. If the machine has some autonomous capability, such as collision avoidance, you start to blur the line. Some of the machines mentioned in the article have the ability to climb stairs, which puts them squarely in the robot category.

      1. Falmari Silver badge

        Re: Remote control is not a robot

        @trindflo "Some of the machines mentioned in the article have the ability to climb stairs, which puts them squarely in the robot category."

        I have the ability to climb stairs that does not put me squarely in the robot category. Climbing stairs does not make a machine a robot any more than flying would.

        A machine that climbs stairs piloted by a human is not a robot. Neither is a machine that climbs stairs piloted remotely by a human a robot.

        1. trindflo Bronze badge

          Re: Remote control is not a robot

          @falmari

          I have not accused you of being a machine, so your ability to climb stairs doesn't imply you are a robot. If you are going to be ridiculous just to argue, I won't answer again.

          For a machine to automatically perform complex tasks, such as climbing stairs, without the operator controlling every motion is in the definition of a robot in a number of places.

          https://en.wikipedia.org/wiki/Robot

          https://www.britannica.com/technology/robot-technology

          https://dictionary.cambridge.org/us/dictionary/english/robot

          https://www.merriam-webster.com/dictionary/robot

          https://robots.ieee.org/learn/what-is-a-robot/

          You seem to be using an outdated meaning to the word.

          1. flayman Bronze badge

            Re: Remote control is not a robot

            It doesn't matter if the machine can be classed as a robot insofar as it can climb unaided up stairs. The only issue here is whether it can autonomously decide to kill someone.

    2. Terry 6 Silver badge

      Re: Remote control is not a robot

      It isn't. Fair enough. But once you have one as sure as eggs someone will seek to *improve* it.

  11. bregister
    Coat

    I suppose it give a new meaning to the phrase "blue screen of death".

    So robots with guns and flying aircraft.

    What happens when they don't keep their licenses up to date?

    Mine's the one suitable for wearing in a pony and trap -->

    1. Anonymous Coward
      Anonymous Coward

      I'm certain especially Ellison will be positively salivating over the idea to hold users at gunpoint until they pay their license fees, and he won't be the only one.

      Maybe it's just me, but I am not exactly enthused about the possibilities here.

  12. NightFox

    Assuming there's not a typo in the article, the original piece of contention was "Robots shall not be used as a Use of Force against any person." - not specifically lethal force. So this would also seem to exclude the use of 'robots' to deliver non-lethal force, including tasers, CS and other incapacitants which there may be a more reasonable case for.

    1. StudeJeff

      Other uses

      Considering that a robot (or drone, these aren't exactly robots) could be made pretty much bulletproof it would make all sorts of sense to build in a few none lethal methods of controlling someone. So let the perp shoot at the machine all he wants as it comes up to him and uses gas, a really loud sound, a net, or whatever to incapacitate him.

  13. Anonymous Coward
    Anonymous Coward

    Pretty soon

    The cops won’t even need to leave the donut shops.

    1. Anonymous Coward
      Anonymous Coward

      Re: Pretty soon

      They could even get the robot to fetch those too..

      1. Anonymous Coward
        Anonymous Coward

        Re: Pretty soon

        Brilliant.

        Cops WFH!

  14. Auntie Dix
    Thumb Up

    Now Available from Roomba: Vac-and-Zap

    Automated, laser-assisted enforcement in the home is an idea whose time has come.

    Zap burglars, free-riding cats, and filthy roommates.

    You choose the joules multiplier, from 1 (stun) to 11 (KFC).

    Coming soon: Outside Vac-and-Zap. Free your 'hood from solicitors, joggers, children, and animals.*

    * "California-Cleaning" upgrade (bums, pushers, addicts, shoplifters, Fecesbook employees, hippie pols, etc.) for an additional charge.

    1. Anonymous Coward
      Anonymous Coward

      Re: Now Available from Roomba: Vac-and-Zap

      Would be cool if they got that laser zapping thing for mosquitos commercialised, because they definitely got it coming. Grr.

  15. Dr Fidget

    Yet again - Sir Terry said it so well

    “Once you had a good excuse, you opened the door to bad excuses.”

    ― Terry Pratchett, Thud!

  16. Howard Sway Silver badge

    There appears to be quite a choice of machines

    "They include: Remotec modelsF5A, 6A, and RONS; QinetiQ Talon and Dragon Runner; IRobot FirstLook; and ReconRobotics Recon Scout ThrowBot."

    Of course it would never happen that the politicians had been influenced in any way by the fact that rather a lot of companies have been spending rather a lot of money developing these things, and could only recoup that if they could somehow persuade the politicians to authorise their use. Once they've added AI, automatic target selection and autonomous weapon firing, the same process can be used to get that accepted too.

  17. Tubz Silver badge

    I can see Project Insight on the horizon, AI taking out those that may be a potential threat or guilty of a future crime, even if currently innocent.

  18. First Light

    Drones

    Sadly, the greater the distance between human and target, the lesser the concern for the loss of life, or so it seems from the use of UAVs in Afghanistan. As the cops are already trigger happy, and don't honour their training to deescalate or establish the actual magnitude of the danger they are facing before shooting, use of robots will end in (more) tears.

  19. drankinatty

    "try not to die by automated car"

    The quip "try not to die by automated car" is either an intentional misdirection or is completely off-point. In the killer robot instance -- there is an intent to inflict deadly harm, with the car it is simple negligence or incompetence in programming or QA or both.

    1. John Brown (no body) Silver badge

      Re: "try not to die by automated car"

      Christine? Killdozer?

      1. M.V. Lipvig Silver badge

        Re: "try not to die by automated car"

        Tesla?

  20. M.V. Lipvig Silver badge
    Big Brother

    It does not surprise me

    that San Francisco is doing this at all. California has the most authoritarian government in the US, and San Francisco has the most authoritarian government in California. Today the robots require a human to push the button, but in a few years the robot programming will be refined until they can identify a person, and identify what they are doing. If the person is in the protected political class they'll be able to kill a person in front of the robot, or direct the robot to kill for them. If not, the robot will make the decision to kill and there will be no recourse. The government's will shall be absolute.

    Sound like I'm off my rocker? Not really. I don't have to walk a path to see the ultimate destination, especially knowing that authoritarian governments have zero value for individual lives unless those lives are part of the political machine. Even then, political lives are replaceable cogs if they no longer follow government will.

  21. This post has been deleted by its author

  22. Eric Kimminau TREG

    Who will be the first US City with Robocop?

    https://youtu.be/mrXfh4hENKs

  23. Anonymous Coward
    Anonymous Coward

    The Vote Passed 8-3

    "After raucous meeting, San Francisco approves plan for lethal police robots" - SFGate

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like