Cool
Nice idea.
Concerned about the proliferation of face recognition systems in public places, a grad student in New York is developing privacy-enhancing hacks designed to thwart the futuristic surveillance technology. Using off-the-shelf makeup and accessories such as glasses, veils, and artificial hair, Adam Harvey's master's thesis …
It's all nice and well for industry buffs to ``predict'' face recognition ``will be everywhere'', just like other (or maybe not) industry buffs ``predicted'' RFID would be everywhere, then proceeded to scam their way into passports everywhere by way of ICAO and a good solid terrorist scare, doing clear but often overlooked damage to privacy everywhere. It's still going to be a problem and another reminder we'll need to think about what we want tracked and where we would like to stay uncounted. Not-knowing is becoming harder every day, but will prove necessairy. Thus we will have to conciously choose. And this requires us the people to speak up.
This sort of thing is why pious jews and muslims both superstitiously prefer to leave things, camels, people uncounted.
On the gripping hand, good job to the OpenCV people to provide us with an open source implementation that could then be used for Adam Harvey's work, for which kudos also.
By the look of the pictures it manages this by putting the individual into a space-timer bubble, partly taking them out of this time frame and placing them into the 1980's. The 80's sphere of influence negates CCTV since the Technology was not widely installed at that time.
Most CCTV cameras are highly sensitive to infrared light, which is helpful since you can illuminate scenes covertly with infrared lamps. However, it shouldn't be difficult to develop face paints which look like normal skintones to us, but which reflect or absorb strongly in the near-infrared. It is also quite possible to put infrared LEDs onto spectacles, which emit strongly enough to interfere with the face-recognition systems..
....That stops you having your number captured on camera. That will only be effective if the cameras are unmanned (in the case of the plates you are fucked as soon as a cop car with a camera sees you as it wont see your plate). It doesn't take a genious to work out that someone who can't be identified should be checked out by a real person on the ground. It also wouldn't be difficult for the camera to alert an operator to a suspicious reading.
Basing this 'theory' on open source software is all well and good but lets face it, in the real world, the most secure and advanced technology is not given out for free.
How's that security-by-obscurity working for you? Only at the upper-ends of military tech are the encryption system themselves secret. And even there the main protection is not letting the certificates/pass-keys/whatever fall into the wrong hands.
The strongest securith (SSH, HTTPS, TrueCrypt etc) is often quite free and open. This is what makes it secure in the first place. Sure you can see how it hashes its bits and what have you - does you sod all good when you don't have the keys.
Most advances in this area come from sponsored academic research and, with few exceptions, academics publish their research publiclly (they kinda have to). So even if you can't get access to "Code Cypher X", the theory on how it will work is out there. And if "Code Cypher X" has a flaw, a smart person can still figure out how to break it. Just look at how long HDTV security lasted, to pick one example.
I put it to you that, barring extreme cases in military-style applications, the most secure systems run on open code. With keys held safely.
Small, bright point sources of light do a lousy job of 'jamming' CCTVs and the like. It'll work if you strap a car headlight to your hat, perhaps... nothing else is going to be really powerful enough to dazzle the camera.
During daylight hours, an IR-cut filter applied to the camera would defeat any sort of IR-camo-makeup attempt, though perhaps it might work against night-vision type cameras (though I doubt it very much).
"Small, bright point sources of light do a lousy job of 'jamming' CCTVs and the like. It'll work if you strap a car headlight to your hat, perhaps... nothing else is going to be really powerful enough to dazzle the camera."
I don't think he's talking about dazzling the camera -- rather he's suggesting that the pattern matching may rely on patches of light and dark not in the visible spectrum, so use of IR masking and/or emission would change the image that the computer sees into "not a face" without affecting the image a man looking you in the eye would see.
if true, the IR-blocking glasses are "dark", then realized that they are merely sensitive to IR, along with everything else. I don't think this is likely to work; if they see well in other bands, they merely install the same IR coating that I get on my glasses on their lens.
Most likely you are correct, that is what the authorities will think and that is what most normal people will believe as well.
Personally, I'm amazed that a ban on headgear and sunglasses is not already in place for all banks and places of commerce. YES, it would be inconvienent for some customers.
However, it's truly maddening how many times security cameras are foiled by con artists, forgers and the like by simply wearing a ballcap and looking down during the transaction. Even if you catch the person, the jury rightly throws out the positive ID because you can't see their face clearly.
Or maybe there's just a raft of check fraud and ID theft in the US...
This is in place (at least the in the UK). Bank clerks will get uppity if you don't remove items obscuring the face (e.g. big hats, crash helmets). I am not sure what the rules are around face-obscuring head gear worn for cultural or religious reasons.
IMHO the should be removed as well.
Balaklava will get you the armed response unit from the local police station
A full Burka (not even a hijab) which obscures all of you will get you an appreciation for being a valued customer with religious rights.
WTF... I really wish they allowed Sikhs to carry their f*** pocket knifes. That would have given everyone the right to declare themselves a follower of Odin, put on a chainmail and openly carry a battle axe. In the name of Valhalla, that would have done wonders to make the tube and commuter trains a more polite environment.
One tiny problem that I can see with this.
Given that the point is to hide your identity from the Man you'll proabably attract a signiificant amount of attention walking round in that get up.
Not really conducive to surreptious operation.
That is until we all start wearing it.
And I can just picture a 50 year old builder in face paint. Nothing to do with the article, I just can.
A lot of those looks would make you appear like Steve Strange circa '82! ( Showing my age now! )
Given face number 2 ( the Apache warpaint look! ), could we all look like Adam Ant, Prince Charming era. Brings back memories of being a daft impressionable 12 year old, raiding his mum's make-up box to try to look like one the Ants!
Before I make an even bigger plank of myself, I'll get me....
Isn´t Superbowl where it is most likely to find men with their faces painted, usually in the colors of the team they support?
That can throw off a facial ID software, but it would be easy to a guard reply to "a thug using blue-white checkers in his face mugged me" situation. (any similarity is coincidental)
William Wallace and Conan wouldn´t be recognized either. Oh wait, nobody will notice a 7-ft tall, 3-ft wide Barbarian or a Scotchsman wearing kilt, wielding a Broadsword or such.
Think about a CCTV camera, even an HD version, scanning a crowd entering a stadium. With the wide field of view to cover the entire entrance, each face will only have a limited number of pixels. And in practice, the actual usable resolution will be worse than that. And they claim to measure various distances of features on the face. To what resolution? How many real (intelligence-bearing) bit combinations will they actually end up with? I smell techno-scam.
Now if the subjects would (one-by-one) helpfully face the camera (filling the frame with their face), then the numbers start to make sense. But even given that, the technology is being oversold, way beyond what makes any sense.
Rather than everyone who is concerned about their privacy learning how to become a high class fashion grade make-up artist, how about we all just go about our daily business wearing full total enclosure latex body suits with full face masks to boot? Anyone else up for this or is this just me?
When they first started installing the mega-expensive facial recognition systems in US airports didn't they establish that they don't really work very well to start with? Change your hat, grow a beard, don't sleep for a day or two and boom! Everyone thinks you're Lady Gaga.
"Harvey's research involves the reverse engineering of OpenCV"
Hardly seems like reverse engineering if you're taking apart documented open source software.
http://www.amazon.co.uk/Learning-OpenCV-Computer-Vision-Library/dp/0596516134/ref=sr_1_1?ie=UTF8&s=books&qid=1271925211&sr=8-1
Well not as challenging anyway...
«As a starting point, Harvey's research involves the reverse engineering of OpenCV, which its creators describe as an open-source "library of programming functions for real-time computer vision." From that work, he developed an understanding of the algorithm used to tell if an image captured by a camera is, say, a car, a building or a human face.»
Wow, the guy's a genius! He reverse engineered an open-source program!
"to study or analyze (a device, as a microchip for computers) in order to learn details of design, construction, and operation, perhaps to produce a copy or an improved version."
I think you (and a few others) have true "Reverse Engineering" confused with the more ill-intended aspect of it. Reverse Engineering is broader than decompiling a program. Analysing facial recognition algorithms with the intent on defeating them fully qualifies to be branded as "reverse engineering."
So mentioning that a pair of dark sunglasses could do it just as well justifies his "research" and theses does it?
No mention of the hoody's favourite of course which not only foils computerised systems, but also manual ones...
Honestly, where can I get a grant for such research? I have a sneaking suspicion that beer makes your legs go wobbly.
(Can we have an icon for the department of the bleedin' obvious?)
http://www.biblepicturegallery.com/pictures/Adults/Thief%20with%20mask%20swag%20bag%20and%20striped%20tee-shirt%20ca.htm
http://www.magicalrabbit.net/servlet/the-169/Burgla-the-Masked-Bandit/Detail
Either way, you'll stand out to human observers, in most places. Mardi Gras and the Edinburgh Festival Fringe are exceptions.
You said they did a sports crowd facial recognition exercise in 2001? Has the computer finished calculating the results yet? Also the printer ink may be fossilised by now...
So lets all look like refugees from Kiss shall we?
Actually it's quite interesting, 2000AD (the comic) was predicting all sorts of things, and I'm sure that something like this form of makeup would have been in it, maybe more for the looking strange than defeating face recognition, but maybe we are going to see this sort of thing soon - after all if you are looking suspicious with a hoody up, the next best thing would be to lose the hoody and look less suspicious, but still be unrecognizable.
If makeup becomes more mainstream, at least the future won't look boring.
ttfn
Kjartan Slettemark, a Norwegian artist, travelled Europe in the 1970s using a picture of Nixon's face with his own beard superimposed on it as his passport photo.
http://www.flickr.com/photos/43686206@N00/426134446/in/set-72157600008019734/
(Paris cos her beard would be very appropriate for Nixon's face...)
...I don't think that the researcher is saying that you need to do big swathes of black warpaint to fool the cameras -- just enough of make-ups slightly lighter than your normal skin tone on normally shadowed areas and slightly darker on normally highlighted ones to make it hard for the FR software to know where those marker points that it looks for begin and end. If it can't find those, or "sees" them in places where they, physically, aren't, then it won't match the points on, say, your mug shot so that match won't be made.
Think about all of those tabloid photos of celebs walking around without their make-up on and how different their faces look when they're not making their cheekbones more proinent and their eyes larger/farther apart/closer together.
Now add in the fact that the patterns shown in the article tend to make the lighter and darker areas that the system looks for less symmetrical than normal and (if the make-up is skillfully-enough applied) you might have a disguise that won't match a previously made FR image AND won't be outré enough to attract the attention of a human watcher. The big black areas in the drawings are simply showing the sorts of asymmetric shapes that can confuse the system and are the equivalent of dyeing specimens on a microscope slide to make them more visible.
Sorry, but I'm afraid that the glam make-up can go back onto the top shelf of the closet.
(Actually, I'm not sorry... [MartinMull] "Remember the '80s? Whoah...! That shit ALMOST came back again...!" {/martinMull}
"make it hard for the FR software to know where those marker points that it looks for begin and end."
I don't think thats what he is saying. Or at least thats not what The Reg's article is saying.
They were saying that the system is divided up, there is a quick algorithm which scans a complete scene and says these pixels here look generally like a face or a car or something, those face shaped pixels are then passed to proper Face Recognition Software (i.e. recognise individual faces compared to a reference image).
The article is saying if your face doesn't look enough like a face to be picked up by the fast algorithm then it's never even passed to the FR algorithm.
So this might work to hide in a crowd where computers are deciding what to scan, but in an enviroment where the image is passed directly to the FR algorithm in higher resolution/low rate of scan environments such as airport security gates where the video is known be a human face I'm not so sure it would work, at least without error codes being flashed up on the operators terminal giving the operator a reason to look at you more closely.
...they were also selling to and consulting for the Allies and the management of Nazi focussed IBM [I guess you're thinking of Hollerith machines] shifted from New York to Switzerland in the Autumn of 1941.
I suppose they regret it now, though I wonder who's tech is used to track and process political detainees in China etc today....
For someone who (like almost everyone) isn't of interest to the government, and isn't planning a crime, this is probably a waste of time.
For anyone (like the great mass of people) carrying a mobile phone, this is probably a waste of time.
That said, I guess one of the defining characteristics of art is that whatever value it has doesn't lie in actually being useful.
I.e. one says "That's a face, just there" - as used in many camera to sort out the focussing - and the others says "This face is HIS face"?
OK, you have to find the face to run recognition on it - but given that faces tend to be found on top of bodies, it's not going to be that had for a suitable algorithm to work out where your head should be. French nobility and a few wives of Henry VIII excepted.
Before you can compare a face against your bad guy database you have to isolate the face from the video stream you're capturing. That seems to be what he's attempting to fool.
But somehow I don't think Osama is going to adopt this kind of "Liquid Sky" makeup just to be able to go to the Super Bowl.
Computing power per dollar doubles every 2 to 3 years. How long do you think face recognition will continue to be ineffective? I give it 5 years (4x as much computing power per dollar) before all government buildings have full time facial scanning, another 5 before big companies and highway toll cameras have it, another 5 before mom and pop stores have it.
That is part of the reason I am very much against banning the wearing of muslim veils, not because I am muslim or religious, but because in the near future covering your face with some sort of veil or screen may be the only way to avoid continuous uninterrupted tracking from the moment you leave your house to the time you come back. If we make covering your face illegal we will have no options.
to show that indeed the face recognition software does not work. The masturbation is in spending billions developing the software that does not work. Proving it can be easily thwarted (and hence pointless) is trying to save money, not an exercise in futility. Conversely, when completely innocent you are dragged into the anti-terrorism kangaroo court having been falsely identified as a TERRORIST, you can, if given the opportunity to open your mouth in the first place, produce these studies to show that "Your honour, the software, it lies!"
Um, as the creator of OpenCV, I thought this was pretty damn funny. By the way, OpenCV is ... open, so you can just look inside, no need to reverse anything.
The face detector there is a bit dated -- it works fairly well, but we are thinking of vastly improving it. Often it is used for "friendly access control". For example, on our new robot, we are thinking of not allowing the operator of our new telepresence robot to see video from the robot unless the operator's face is also being transmitted to the robot.
If you want to really challenge the state of the art in face detection, you probably have to go against Omron corporation http://www.omron.com/r_d/technavi/vision/okao/detection.html
Made my day.
First I thought it was about making yourself look like a known villain. You know, to overload the system, if it catches on. Why reverse engineer the technology then? Obviously, so you can design a make-up, that deceives the machine, but still looks more or less like yourself to the human eye.
Jimbo 6: "Last time I went to a sports stadium you had to access through a narrow turnstile..."
No, you had to pass through one of many dozens (perhaps a hundred) narrow turnstiles. This massive IT multiplier moves the decimal point about two positions to the right and turns the whole thing into a financial fiasco with zero upside.
And the facial recognition techno-scam artists have made fraudulent claims about "scanning the crowd..." [at the Superbowl] "...to look for terrorists". And the people with the applicable anti-terror budget are so massively tech-illiterate that they can't even perform the rough order-of-magnitude math in their head to notice that it's mathematically impossible.
Marketing of purported automatic facial-recognition schemes are a bit like Fermat's Last Theorum. By the time they actually solve it (maybe 15 or 20 years from now), it'll reveal just how difficult a problem it really was. Thus proving that the early-2000-era claims were bogus.
Geesh, the "Hey it's a face (I think)" systems barely work.
Moi?
My point was apparently insufficiently clear. For this I apologize and offer this more-verbose version:
Wiles proof of Fermat's Theorem is so exceedingly complicated and modern that there's little wonder that Mr. Fermat's book margin was "too small" to contain his proof. In other words, the proof by Wiles reveals that Mr. Fermat was either deluded, or joking.
Similarly, by the time facial recognition (of the general real-time arbitrary terrorist-spotting variety), *actually* works - years hence - it'll become obvious in hind-sight that the present-day claims must have been pure rubbish.
Clear?
...is, for the moment at least, rubbish. A way to extract cash from wannabe Big Brothers.
But for one of its originally intended purposes its not too shabby at all.
Take single piccy of unknown miscreant from security footage. Compare said piccy to huge database of known miscreants (or even of liscence photos) and extract small subset of close matches. Hand off to a real person to make a final comparison.
If /when the technology ever advanced to the point where it can name/label every individual in a crowd, defeating it would still be as simple as injecting an irritant such as bee venom into the eyelids/lips/nose to create swelling