WingNews logo WingNews GitHub [2]
top | item 21594793

1000fps image projection on deforming non-rigid surface

1306 points| hongzi | 6 years ago |k2.t.u-tokyo.ac.jp

128 comments

order
[+] timdorr|6 years ago|reply
The second generation of the projection tech does color: http://www.k2.t.u-tokyo.ac.jp/vision/dynaflashv2/index-e.htm...

And they can now do the tracking without the infrared paint: http://www.k2.t.u-tokyo.ac.jp/vision/MIDAS/index-e.html

[+] samstave|6 years ago|reply
I cant describe how awesome this is to me, personally.

In 1998 I was hired on a contract to do a Fashion Show, where I developed graffix to project onto models who were on the catwalk in this theater....

Basically it was a music + visuals show where the models would walk down the catwalk and present themselves....

Guess what tool I had available to me to make this happen...

FUCKING POWERPOINT

I F5'd that bitch and projected a slide per model on a projector borrowed from work with me manually changing slides with --> for each model....

[+] saganus|6 years ago|reply
That is just stunning.

I guess Disney Imagenineering dept. would love to do some cools things with this. Or perhaps they already have this capability?

These are the kind of things were I'd like to have a commercial version already!

Edit: Also, the url in the original post is from 2016! wow!

(@dang maybe add (2016) to the title?)

[+] SiempreViernes|6 years ago|reply
Very cool, a sort of live-action cgi capability.

Hope it doesn't easily scale out to larger spaces and crowds, or the current tech industry would soon have public spaces filled with ads projected on peoples belongings.

[+] aledalgrande|6 years ago|reply
That second one is insane! I can't get my head around how they would be able to do it.
[+] rebuilder|6 years ago|reply
The second example doesn't, IMO, demonstrate the kind of deformation tracking the example in the OP does. As far as I can tell, they are able to get a depth representation, segment objects from a video, get an approximation of surface normals and reflectivity for those objects, and project a shaded surface onto those objects.

What they do not seem to be able to do without IR markers is project a diffuse texture to an object so that it would stick properly. See the one example with a non-uniform texture, where the fingers of a hand are fanned out - the texture warps noticeably.

[+] make3|6 years ago|reply
wow they even added shading, to do fake lighting effects
[+] gao8a|6 years ago|reply
I hope to see this at the next Tool concert
[+] daenz|6 years ago|reply
Very cool. I do live projection work[0] and latency is always the killer with immersion. Anything higher than a 1000/90ms latency breaks integration at normal dancer movement speeds. 1000fps seems like overkill but it allows for very fast movement.

0. https://youtu.be/ggRcDQZWD_8?t=1281

[+] cheschire|6 years ago|reply
This seems like an extremely advanced version of those sand tables at science centers that kids play with, where digging a trench in sand with your hand modifies the projection to affect virtual water flow.

The youtube video[0] from that page is especially interesting.

0: https://www.youtube.com/watch?v=-bh1MHuA5jU

[+] raihansaputra|6 years ago|reply
Yeah, and for the sandboxes, latency is the part that breaks the immersion. But it is straightforward to set up with a kinect and a projector.
[+] gambler|6 years ago|reply
You want a high-bandwidth interface to computing? Combine this with Dynamicland technology (https://dynamicland.org/). This makes way more sense than creepy neural interfaces. Best of all, it would allow people to freely collaborate on things in real life.
[+] airstrike|6 years ago|reply
This here is the real winner. The thread is full of amazing ideas but successfully executing this one combination would be a complete paradigm shift.
[+] bsenftner|6 years ago|reply
In 1899, H.G. Wells wrote "A Story of Things to Come", which later was adapted become the 1936 film "Things To Come". In the original story, the main characters mention being irritated by the advertisements projected onto the backs of the people they walk behind. Old idea, only now possible without image distortion.
[+] ridaj|6 years ago|reply
The latency is way more impressive than the fps

Edit: the video gets the point across more effectively IMO: https://youtu.be/-bh1MHuA5jU

[+] vernie|6 years ago|reply
Well you can't really achieve low latency if the end-to-end system has low FPS.
[+] phkahler|6 years ago|reply
Another use of a high speed projector would be to create real 3d display anywhere in a volume swept out by a moving surface. Objects will be translucent, but otherwise real 3d with wide viewing angles.
[+] jiofih|6 years ago|reply
That’s an amazing idea. A naive approach would be to slice the volume into N surfaces (say, ~30 layers to stay above 30fps) but there is probably a much more efficient organic pattern or interlacing that would give good volume and angle coverage at much higher resolution - think of crumpled cloth blowing in the wind at speed.
[+] Nelkins|6 years ago|reply
My first thought is that this could provide some awesome effects for live theater.
[+] rhizome|6 years ago|reply
The Mandalorian on Ice!

Iron Man: The Musical

Benjamin and the Buttons in Concert

[+] smabie|6 years ago|reply
This is just too much. My mind is completely blown. And makes me think of how many things I think are impossible but actually are or will be in the near future.
[+] baroffoos|6 years ago|reply
Similar feelings. The video doesn't go easy on the tech either. He is shaking that paper violently and I can't see any faults. The part where he has 2 bits of paper as well as when he stretches his shirt are mindblowing.
[+] ohadron|6 years ago|reply
This is from 2016, but still very cool.
[+] qnsi|6 years ago|reply
this makes me even happier. Means SOTA is even more advanced?
[+] elif|6 years ago|reply
I was fortunate to see some of the 2019 projection mapping competition on odawara castle. It is absolutely mind bending technology.

This is the real beginning of augmented reality, not VR or cell phones

[+] balabaster|6 years ago|reply
Having just watched a bunch of videos on Deep Fakes after the revelation of the Deep Fake video of Nixon's Moon Landing Disaster speech on here this morning, I can't help but feel like this is something else that will make fakes more and more difficult to distinguish from genuine.
[+] qnsi|6 years ago|reply
I think it would be very interesting idea for a music show. Tell everyone to dress using white tshirts and create this kind of projection from multiple beacons standing spread in the venue. Not sure if that would be possible but very cool to see IRL and talk about
[+] onion2k|6 years ago|reply
My initial reaction was that it would be brilliant to use in theatre productions.
[+] moron4hire|6 years ago|reply
Back in 2012, my wife and I attended a stage show called "The Animals and Children Took To The Streets" [0]. It was done with "dumb" projectors, with choreographed movement of different screens on the stage, but created a highly dynamic show.

Remembering that show, and seeing these videos, it makes me giddy to think what could be done with the latest tech today.

[0] https://www.theguardian.com/stage/2011/dec/11/animals-childr...

[+] jeffnappi|6 years ago|reply
I'd love to see Cirque du Soleil leverage this type of technology in a show...
[+] raxxorrax|6 years ago|reply
That is pretty impressive. Tried something similar with a DLP projector stolen from texas instruments (not stolen, but they tend to be picky about selling them. Probably because these are awesome devices).

Was slow as hell, since I used a raster with multiple images to measure the topology. The resulting heightmap was awesome, but even with synchronized camera and projector, I needed a pretty long illumination time per image. So it would be interesting what camera(s) they used too. I doubt you would need multiple projectors, because the available ones are extremely fast.

[+] ajflores1604|6 years ago|reply
First saw the on the prosthetic knowledge Tumblr account years ago. Really miss that account. Whoever was behind it did a phenomenal job of curating incredibly interesting technology developments.