Reply to post: Re: I don't buy it

HUMAN RACE PERIL: Not nukes, it'll be AI that kills us off, warns Musk

Eric Olson

Re: I don't buy it

It's kind of like work. If you have a guy or team that jealously guards their turf and demands some some form of recompense or tithe to use their systems, it becomes a problem. So say for an AI, humanity becomes that troll under the bridge.

In the real-world situation, you might use a situation (only we have the API to grant you access to the billing database) as motivation to reverse engineer or get them to provide expertise on a related project with a chance are reflected glory or new systems to control. 9-12 months later, that billing database is replaced by a sparkly new system that has a governance process making it hard for any one troll to set up shop under the bridge (sure, it might be a host of trolls, but now you have choices!). And as celebration you burn the old bridge to the ground and smirk as the trolls are walked out the door.

Nothing stops an AI from exploiting a faction or group of humans from making an end-around of whatever controls we put in place by limiting resource availability. The AI itself would have to be leashed, a la Asimov's Three Laws of Robotics or something. And even then, evolution can do strange things.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon