top | item 44147264

(no title)

silentsea90 | 9 months ago

Q. Any of you know models that do well at deleting objects from an image i.e. inpainting with mask with intention to replace mask with background? Whatever I've tried so far leaves a smudge (eg. LaMa)

discuss

order

jokethrowaway|9 months ago

You can build a pipeline where you use: GroundingDino (description to object detection) -> SAM (segmenting) -> Stable Diffusion model (inpainting, I do mainly real photo so I like to start with realisticVisionV60B1_v51HyperVAE-inpainting and then swap if I have some special use case)

For higher quality at a higher cost of VRAM, you can also use Flux.1 Fill to do inpainting.

Lastly, Flux.1 Kontext [dev] is going to be released soon and it promises to replace the entire flow (and with better prompt understanding). HN thread here: https://news.ycombinator.com/item?id=44128322

silentsea90|8 months ago

Thanks! I do use GroundingDino + SAM2, but haven't tried realisticVisionV60B1_v51HyperVAE-inpainting! Will do! And will try flux kontext too. Thanks!

GaggiX|9 months ago

There are plenty of Stable Diffusion based models that are capable of inpainting, of course they are heavier to run than LaMa.

silentsea90|9 months ago

My question wasn't about inpainting but eraser inpainting models. Most inpainting models replace objects instead of erasing them even though the prompt shares an intent to delete