Ooh, this seems interesting ! I'm working on tracklab (https://github.com/TrackingLaboratory/tracklab), I might try to implement this in the visualization pipeline, which needs some work right now.
What can I potentially get out of VidFormer when there are a lot of annotations to show ?
There are a few benefits, depending on your use case; most of them are reducing video length as a barrier to visualization.
1) If you are running models you can use vidformer to see the results as they come in, essentially streaming annotated videos to your web browser as your model runs.
2) If you have existing inference results you can practically instantly render those on videos, then you can iterate or remix in seconds.
3) If you're hosting any infrastructure you can expose VOD streams publicly to show annotated videos to web clients. For example, it's trivial to build a video search engine which returns compilations.
dominikwin|1 year ago
1) If you are running models you can use vidformer to see the results as they come in, essentially streaming annotated videos to your web browser as your model runs. 2) If you have existing inference results you can practically instantly render those on videos, then you can iterate or remix in seconds. 3) If you're hosting any infrastructure you can expose VOD streams publicly to show annotated videos to web clients. For example, it's trivial to build a video search engine which returns compilations.
tzm|1 year ago