top | item 6302269

The Face Scan Arrives

48 points| zweiterlinde | 12 years ago |nytimes.com | reply

49 comments

order
[+] wes-exp|12 years ago|reply
As the article says,

"Before the advent of these new technologies, time and effort created effective barriers to surveillance abuse. But those barriers are now being removed. They must be rebuilt in the law."

Time and effort maintained privacy in the past, by default. However, as technology improves, privacy is no longer the default, so we need to request it, specifically.

I hear again and again that "no one cares about privacy", but I'm starting to think this is a relic of the past. Perhaps 10 years from now we will say "no one used to care about privacy, but that was before technology became sufficiently advanced."

[+] astrodust|12 years ago|reply
Guess it's time for dazzle paint to become a trendy new fashion statement. (Example: http://cvdazzle.com/).

Someone like Lady Gaga is basically untrackable if she's wearing any of her usual ununsual outfits.

[+] mistercow|12 years ago|reply
Given the rate of false positives when "cold hits" are used with DNA databases, facial recognition (which is presumably higher entropy than DNA) has the potential to send a lot of innocent people to jail.

I also have some concerns of inadvertent "software racism". See for example, this video: https://www.youtube.com/watch?v=t4DT3tQqgRM. Obviously facial recognition isn't inherently incapable of recognizing people of different races, but if it's designed and calibrated on subjects of one race, it won't necessarily work well for subjects of different races. The last thing we want is a facial recognition database that thinks e.g. all Arabs look alike.

And of course, there are a ton of ways that it can be thwarted easily and inconspicuously, even if it works very well. Are all surveillance cameras going to be fitted with IR filters to ensure that a bright IR LED necklace doesn't blind them? And how hard is it for a criminal to hire a makeup artist?

[+] unono|12 years ago|reply
If VR headsets like Oculus Rift take off, this problem can be mitigated. People will walk around with headsets to cover their entire face, defeating the cameras.

Surveillance is going to happen, if you ban government surveillance, the public will get this tech and drones and be doing it anyway. So the robust way to fight it is to plan your life knowing that you can always be monitored and someone will always know where you are, even at home.

This is a great opportunity for startups. Webapps that allow you to plan your security, kind of mini-fiefdoms with your family, friends, neighbors, associations that plan against attacks from rivals. Electronically activated weapon systems that shoot when a threat is detected. The Mad Max era is coming, and hackers will get many opportunities to earn a fortune.

[+] learc83|12 years ago|reply
>People will walk around with headsets to cover their entire face, defeating the cameras.

You can already obscure all of your face except for your eyes with just a strip of cloth, which will have the exact same effect.

[+] ryusage|12 years ago|reply
A friend of mine sent me this video just yesterday, showing the feed from a FPV quadcopter:

http://www.youtube.com/watch?v=TrVLh6r8hd8&feature=player_de...

Because it wasn't clear to me at first, I'll just point out that the pilot for this thing is using a VR headset similar to Oculus Rift, and the video is sent back to him over wifi. Supposedly the range is on the order of a mile or so.

I didn't even realize this was a feasible thing already! Looking into it, you can get these things for only $1500 or so. And so suddenly I've just realized, 10 or 20 years from now, it's not just the police who will be flying these things around. Why not buy one to use for your own neighborhood watch, right?

Hell, I'd love the chance to fly one of these around just for fun.

[+] cbhl|12 years ago|reply
Perhaps, but the cameras on the VR headsets will provide even more data for the government for those who don't have an anonymous face; especially if the data is sent to a central server for processing (ala Google Glass).

Plus, unless you build the hardware entirely yourself, the headset won't save you from other tracking technologies. Presumably the headset will have a wireless chip whose MAC can be tracked, or, worse, it'll have an RFID chip specially-built for government tracking.

[+] anigbrowl|12 years ago|reply
People will walk around with headsets to cover their entire face, defeating the cameras.

Let's face it, you're won't going to walk around with a VR headset on your face unless you're a) wireless connected to a server, or b) enjoy taking a heavy backpack or cart of gear everywhere.

[+] marincounty|12 years ago|reply
1. I know one thing. I am tired of my picture taken whenever I walk into a store. In order to buy a bolt at that mess of a store(the big orange); my picture is taken multiple times. It pisses off customers like myself, and every year for as long as I can remember, the majority of theft is internal. The worst offenders are Management.

I think you will see a rise in people wearing desquises? Or, maybe an Indian will eventually sue the offending store on religious grounds? (steal the soul)

Yea, I'm rambling, but I sometimes feel like we lost all privacy? And yes, this is the only site I comment on anymore. I don't even trust this site. I bet they are logging in all IP's, and saving them just in case the government comes a knocking?

[+] safeaim|12 years ago|reply
How long until VR headsets are the size of a eye lens? And do you really think most people want to wear a VR headset all day long?
[+] varelse|12 years ago|reply
Given the 15.8% success rate of the cat detector on large data sets: http://arxiv.org/pdf/1112.6209.pdf&embedded=true,

My chief worry is overconfidence from hopelessly technologically ignorant bureaucrats combined with a slew of false negatives and false positives when applied to human faces on general surveillance feeds.

In contrast, driver's license, ID, and arrest photos are at least severely constrained input filters wherein a single individual is placed against relatively uncomplicated background pixels and the face is in roughly the same orientation.

[+] nathan_long|12 years ago|reply
I don't know about the cat detector, but Picasa seems able to identify people in photos pretty well, despite varying positions and lighting conditions.

It creeps me out.

Granted, they are working with the much smaller set of people I know rather than the whole populace. But technology only gets better.

[+] frenger|12 years ago|reply
> "While this sort of technology may have benefits for law enforcement (recall that the suspects in the Boston Marathon bombings were identified with help from camera footage), it also invites abuse."

1. Yes /without/ this technology, and

2. How would that have prevented the Boston tragedy if it were in use?

What exactly does NYT mean here.

[+] dougmccune|12 years ago|reply
When they identified the first blurred images of the suspects' faces they put out the images hoping people could help identify the faces they were interested in. I assume they're saying that with better technology they'd be able to instantly identify those faces, instead of relying on putting them up on TV (where the suspects can see them and know they're on to them). So it wouldn't have prevented the attack, but it theoretically would have made the identification easier, and the arrests faster/less deadly I suppose.
[+] roc|12 years ago|reply
> "But as surveillance technology improves, the distinction between public spaces and private spaces becomes less meaningful."

Or more to the point: as the NSA mandates access to all private data, the distinction of recordings from public spaces and recordings from private spaces is made moot.

[+] wicknicks|12 years ago|reply
Does anyone know how this can be technically achieved? Large scale face recognition with 1 photo per person in the training set?
[+] bsenftner|12 years ago|reply
Yes, it exists, and I use it every day. In fact, I have a partnership with the DOD/NSA subcontractors who created it, and I have applied the technology to the automated creation of 3D Avatars given a single photo of a person's face. My version of the tech is available at www.3D-Avatar-Store.com. The system works as follows: a person's head is laser scanned, at the same time dozens of single photos are taken of that person from different angles, different lighting conditions, and different quality cameras. Then a neural net is trained to associate each photo with the laser scan data. After a few thousand trainings, anyone's single photo would generate a reasonable likeness of them in 3D. Today, after over a decade of training and 10's of thousands of scans added to the training database, we get remarkably good quality 3D reconstructions given a single photo of anyone, any age, any ethnicity. There are limitations, such as the face needs to be visible, and it needs to be within +/-30 degrees of facing the camera for the 3D reconstruction to be suitable for facial recognition. And that is the point of the original application of this technology: a facial recognition pre-processor. It corrects the face angle and removes any facial expression, creating a likeness of the face in a passport style photo perfect for facial recognition. But, of course, I'm not using it for that. I use it to auto-magically create 3D avatars for video game studios.

Oh, it's really, really fast. My current system is based upon two generations back of neural nets, and they reconstruct from one photo in 0.9 seconds. The latest generation does 144 reconstructions simultaneously given HD video feeds.

[+] nathan_long|12 years ago|reply
Maybe not in realtime, but they could store all the images and maybe have software presort faces by similarity. Then if they became interested in a specific person, they could input more training images and sift through the set of similar ones.

They might find hundreds of pictures of you with timestamps and locations.

(This is all speculation; I haven't written image recognition software myself.)

[+] IanCal|12 years ago|reply
Why does it need to be a single photo? Mandate that when you get your passport/driving license theres a face scan. Wouldn't be amazing tech and could be introduced fairly easily.
[+] therobot24|12 years ago|reply
I do it with only a single ocular image (eye, eyebrow, and surrounding skin texture) rather than the full face. Using 1:1 matching environments are common for NIST challenges.
[+] Raphael|12 years ago|reply
Perhaps with the help of Facebook. It's right in the name.
[+] frenger|12 years ago|reply
Well, we know they archive Facebook content so go figure
[+] crazygringo|12 years ago|reply
I don't think even people can do it from just a single photo in a training set.
[+] amirmc|12 years ago|reply
I notice the article didn't use it as an acronym - BOSS "Biometric Optical Surveillance System"
[+] outside1234|12 years ago|reply
Did they really name a system such that its acronym is "BOSS"? :)