top | item 23369706

Vibe: Video Human Pose Estimation

93 points| ericsson_puma | 5 years ago |github.com | reply

15 comments

order
[+] dbcurtis|5 years ago|reply
Restrictive license.

The have a nice comparison to T-HMR, but I did not see a comparison to OpenPose. If that exists somewhere, please give me a pointer.

[edit] OK, so I read a little further. Answered my own questions a bit, so here is what I found:

VIBE produces 3D pose from 2D video. OpenPose needs stereo video for 3D pose estimation. OpenPose can produce 2D joint position tracking from 2D video. OpenPose 2D annotations were used to automate labeling input data sets for training VIBE.

So, OpenPose: 2D video -> 2D pose estimate. VIBE 2D video -> 3D pose estimate.

[+] ericsson_puma|5 years ago|reply
It also estimates the full body mesh, not only the 3D pose of a few joints.
[+] benrbray|5 years ago|reply
You seem to point out the restrictive license (for non-commercial research purposes only) as if it's a negative, when I don't believe that it is.

Why should companies be allowed to profit from a proprietary wrapper around open-source software built on top of decades of open-access research? Open research should stay open.

[+] mandeepj|5 years ago|reply
I think it can be used in building a workout app to assess whether your pose is correct or not for the exercise you are doing
[+] dbcurtis|5 years ago|reply
Indeed. Or other sports applications. I have a friend that is an elite-level track coach. She has an iPad app that helps analyze running form from video. This tech could be used to improve apps like that.

My own little pet thought experiment for years has been an app that would track violin or 'cello bow motion to provide feedback to students on bowing technique. I am sure there are many similar applications.

[+] wellthisisgreat|5 years ago|reply
occlusion is an impassable barrier in this case it seems. For some motions it can work, but if you can't see some limbs behind the back etc. there is not much that can be done regardless of the estimation
[+] mhh__|5 years ago|reply
Seems like a good use of the technology but this seems fairly computationally expensive
[+] AlleUndKalle|5 years ago|reply
Colab demo is quite nice. These kind of research projects should definitely provide easy to use Colab notebooks for users to interact.
[+] noodlesUK|5 years ago|reply
Are there any similar libraries to this or openpose that have FOSS compatible licenses?