A Computational Approach for Obstruction-Free Photography [pdf]

[mrb]

Very cool. But one inconvenient is that the processing they do removes all moving objects from the image. Look at page 10 of the paper: the 8 cars present in the original image on the road are absent from the reflection-free image.

[baseballmerpeak]

If the cars are what you wanted in the picture, it is a shortcoming. However, they are not part of the background (i.e. static imagery).

[beobab]

I would love to have the app which they talk about in this paper on my phone. I suspect that people would pay good money for this.

[tonylemesmer]

This in combination with the software (Microsoft was it?) that composites photos of people eliminating ones where people aren't smiling or are blinking would be epic.

Kinda seems like how humans perceive scenes - our brains somehow block out wire meshes, or raindrops if we are looking through them.

[zimpenfish]

Definitely would - trying to get decent clear shots out of office / transport windows is an exercise in "blocking overhead light reflection" frustration.

[ghughes]

Their ability to recover the reflected image seems valuable to security agencies.

[jakobegger]

Ohhh this is beautiful. I have this childhood memory of my father trying to take pictures of vases behind glass in the museum, struggling to find an angle at which the polarization filter would remove most of the reflections on the glass display case...

[rmc]

How come I see videos from academics for really really cool things like this. But I can't buy an app that does it?

[adrianN]

Because academics are paid for papers and turning a paper-ready piece of software into a consumer-ready piece of software is a lot of work that could be spent on writing the next paper.

For this particular example I would guess that the implementation is a bunch of matlab scripts that need manual fiddling to work for a particular input. Since you don't have matlab on your phone, porting it is quite difficult.

[mintplant]

This research was partly sponsored by Google, so I imagine the tech will ultimately find its way into the Android camera app.

[kazinator]

The eyelets in a fence are much larger than your average camera lens. If you can go right up to the fence, the problem is solved.

Reflections from glass are minimized by also sticking the camera lens right up to the glass, and providing some shading around it. A simple lens skirt could be developed for this purpose (if such a thing doesn't exist already).

Possible design: cone-shaped coil spring encased in opaque cloth, with rubber o-ring gaskets fitted on both ends. One gasket (narrow end) goes on the camera/phone around the lens, the flared end gasket goes onto the glass.

[leni536]

It could be interesting to apply it on existing videos on youtube. It could reveal some perceptually hidden information out of reflections.

[mirzmaster]

Here's the official Siggraph 2015 submission, linking to both the PDF as well as the demonstration video:

https://sites.google.com/site/obstructionfreephotography/

[jberryman]

https://upload.wikimedia.org/wikipedia/en/e/e5/Magritte_TheS...

[bmarx]

nice work! what are the applications for that besides taking clean pictures behind a glass windows or a fence?

Security agencies applying that algorithms to see if they can obtain some extra information out of the reflected pictures?

[WillyNourson]

Ah, the end of the bathroom-mirror selfies ? :D

[jacquesm]

This could be a nice feature on a camera, but you'd need a second sensor offset from the first to make that work.

[gus_massa]

From the article:

> The input to our algorithm is a set of images taken by the user while slightly scanning the scene with a camera/phone [...]

As mrb noticed, this has the side effect that the algorithm removes moving object from the scene, for example cars.

[scoot]

RTFA: this is covered in the Fig 1. Description, and the abstract.

[baq]

examples in the pdf have a CSI zoom-enhance feeling to them... good stuff.

[medecau]

TL;DD (Too Large, Didn't Download)

I did search google for "Obstruction free Photography" and there is one video on youtube that explains the technology and provides examples.

https://www.youtube.com/watch?v=xoyNiatRIh4

[lqdc13]

The file is 31mb. The video you linked is 75 mb in 720p.

[agumonkey]

Remarkable results, especially the 'removed' artefact turning into another clear picture.

[beobab]

It does have a lot of example photographs in it, but it's only 32Mb.

[Frenchgeek]

Look like one side effect is removing anything that move, like the cars in one example in the video...

[ChrisArgyle]

This seems to be a trend with academic articles. I don't think they have bosses saying "that's great but Page Speed says..."

[baseballmerpeak]

Enhance. Enhance. Enhance. Just print the damn thing![0]

[0] https://www.youtube.com/watch?v=KiqkclCJsZs