top | item 287626

Real-time tracking of human eyes using a webcam

34 points| soundsop | 17 years ago |codeproject.com | reply

11 comments

order
[+] jonas_b|17 years ago|reply
There is a Swedish company called Tobii that does something similar yet a lot more advanced, including lasers and what not to track eye-movements.

One of their ideas is that people with physical handicaps could use their eyes instead of mouse/trackpad to point and click at stuff, but if this could be done with a webcam that's even more better. If you could click on you IPhone only using your eyes, wouldn't that be cool?

[+] hhm|17 years ago|reply
However, it's quite improbable you'll get an interesting resolution for your movements with a webcam, compared with lasers or other methods. Image-based eye tracking needs to be real-time (so probably inherently low resolution these days), tracks objects that are an important part of the captured image (so you get like a much lower resolution mouse, because of the size of your eyes or pupils compared to the webcam resolution), and needs to compensate for errors so it needs a lot of redundancy in data to generate output (so decreasing the resolution even more).

Anyone working in computer vision can tell me if I'm right or wrong? I've been working in the area in some small projects, but they were extremely related to this eye-tracking stuff.

[+] IsaacSchlueter|17 years ago|reply
A webcam, eh? I always keep track of my human eyes using egg crates. They're just the right size, and you can label the outside with sharpie...
[+] DenisM|17 years ago|reply
Somebody needs to commercialize this, stat. I would love to get visual heat map of my web site - which portions of the text user looks at?
[+] jyothi|17 years ago|reply
Few things I can think of..

1. Usability tests (including heat maps and replays for manual observations)

2. Measuring effectiveness of display ads (web, TV etc) more concretely.

3. Accurate Strabismus (Squint) recognition and measurement.

[+] stcredzero|17 years ago|reply
Heat maps could also be utilized to provide a computer system a probabilistic notion of the "current object" that the user is referring to. If a computer system could respond to where the user is looking, this could augment verbal input greatly. The computer might actually stand a chance of knowing what the user means when she says, "I want you to look up that."
[+] asif|17 years ago|reply
I can't seem to get this thing to figure out where I'm actually looking. Isn't that the point of "eye-tracking"? It is pretty good at figuring out where my eyes are located on my face, but that isn't very valuable information.

Has anyone else had any success?

[+] antirez|17 years ago|reply
Is not it too much stressful to use eyes as an input device? I don't think there general uses for people that can use a mouse. I think that the next revolution in input devices can be a keyboard that is actually like the iphone a display + touchscreen so that the keyboard will drastically change in order to be application-specific.