Make photomosaics, GIFs, and murals from pictures in Python with ML/OpenCV

[dfbrown]

I'm not an expert in the topic, but my understanding is RGB is a poor color space for computing color difference. This could be why your mosaics end up so washed out. [1] suggests using a CIELAB color space [2].

Edit: Looking at the code more closely it looks like you were using Lab at one point but commented it out[3], so I'm guessing you're already aware of this.

1: https://stackoverflow.com/a/9019461/185171

2: https://en.wikipedia.org/wiki/CIELAB_color_space#CIELAB

3: https://github.com/worldveil/photomosaic/blob/bb720efda11383...

[muzakthings]

It didn’t make a ton of difference empirically when I tried it.

But you’re correct, generally that’s the space you want to be in.

[fireattack]

Is the example image (https://github.com/worldveil/photomosaic/blob/master/media/r...) with or without opacity cheat?

[muzakthings]

Both! You can experiment with —-best-k and —randomness <1.0 and sort of get things in the middle.

Basically what this will do is assign each tile less than 100% of the time randomly and then for each that isn’t, you choose among the top best K matches on L2 distance with equal probability. Gives it a little bit of both.

[PavlovsCat]

Yeah that's using opacity, e.g. there's an image of a blue horizon that gets tinted red.

[rmonroe]

Way better implementation of the face alignment than what I did for our peru trip. Good going ;-)

[androidgirl]

The gif with facial recognition is actually really really cool. Awesome work

[aaaaaaaaaab]

Ok, but where is the ML part?

We’ve been creating these mosaics for decades...

[muzakthings]

The face montage building trains a linear classifier on top of the pretrained embedding network - it’s the portion that talks about creating a training folder of your face.

But yes the photomosiacs strictly don’t use ML, unless you count the internal fun stuff Faiss (the similarity search lib) does to construct fast indexes.

[simple10]

It's using the KMeans[1] library from sklearn.cluster. But this isn't really ML, is it? My ML knowledge is limited. Regardless, it's a cool project. OP might want to update the title to remove ML.

[1] https://github.com/worldveil/photomosaic/blob/master/emosaic...

[itronitron]

like others here, i really like the aligned face montage gif and it seems like it would be a great product for people to package up their selfies over a timeline

[giladoved]

This is fantastic, great project!