top | item 39431977

Why it is so hard to build a AI Video Editor?

3 points| asaayushii | 2 years ago

Now Sora is in town but still I can't find any platform that converts raw clips to edited,engaging clip with B-Rolls,transitions and subtitles in single click and no manual intervention. Should I think about building one?? IS IT WORTH IT? What say?

11 comments

order

PaulHoule|2 years ago

So far you chose to fail in the exact same way that 99% of A.I. dreamers choose to fail. How is that: bad smell number one is "...single click and no manual intervention"

(1) If you hired somebody to make a video of course you would talk to them about the video you want you want made. At some point in the creation process you might look at the video and give some feedback and your video producer could adjust accordingly.

Since there are many decisions that have to made to make a video (say 20 in a one minute video), even if the system makes the right decision (for you) 90% of the time it is inevitable it will make a terrible decision if the length of the video increases.

(2) The ability to use feedback would be a secret weapon against people who choose to make their product impervious to feedback.

(3) If you get that feedback over the long term the system can use that as a training/test set and will help the system make the right decision more often.

Training data: the way out is the way through.

asaayushii|2 years ago

when AI can be a good product manager, it can also be a good video editor..the prompt enginnering and fine tuning plays a very imp role here.

To be more precise...It will make video editor and content creator task easy..not a replacement for them.

gmreads|2 years ago

Klipme claims to do this exactly. I've been on the lookout for such tools, to generate reels/vlogs from my huge raw content. Happy to bounce ideas and contributing to build one.

asaayushii|2 years ago

I checked Klipme..it can generate shorts with little bit editing that only we need to do. I was looking for something where that editing(B-Rolls/transitions/subtiles/BG Sound) also get added by AI .

codemusings|2 years ago

> Should I think about building one??

Definitely. Seems like you have a good grasp on the problem space.

asaayushii|2 years ago

Thanks! Will soon start with the enginnering after user validation.