[throwaway4837]

It can work well for restricted inputs, like Twitch Plays Pokemon. The FREE Movie is too open-ended. They should do a simple distance check to throw out frames that don't overlap much with the original frame. They could also have a frame-voting mode where you basically just get a stream of frames and swipe right if it looks good, left if it looks bad, then use the crowdsourced data so that the movie plays with the current highest voted frames.

[jerojero]

You don't wanna replicate the movie. I imagine if you add colours, for example, you could make your own interpretation of the colour palette and so something really amazing but as a distance matrix... you'd be way off.

I think just adding some kind of moderation, for example allowing people to select the best frames out of a set of frames and so on, might be enough to get a much higher quality product.