top | item 45997178

(no title)

Wyverald | 3 months ago

thanks, I love your website. Are you planning to do NB Pro for the text-to-image benchmark too?

discuss

vunderba|3 months ago

Outside the time frame of being able to edit my original reply, but I've finally re-run the Text-to-Image portion of the site through NB Pro.

  Results

  gpt-image-1: 10 / 12 
  Nano Banana Pro: 9 / 12
  Nano Banana: 8 / 12

It's worth mentioning that even though it only scored slightly better than the original NB, many of the images are significantly better looking.

https://genai-showdown.specr.net?models=nb,nbp

happyopossum|3 months ago

Awesome test suite. For the maze though, not sure it’s fair to knock it for extra dashed lines as the prompt didn’t specify that only the correct path should have one…

Wyverald|3 months ago

thanks for the update. One small note: for the d20 test, NB Pro had duplications of 13 and 17 too, not just 19.

vunderba|3 months ago

Definitely! Even though NB's predominant use case seems to be editing, it's still producing surprisingly decent text-to-image results. Imagen4 currently still comes out ahead in terms of image fidelity, but I think NB Pro will close the gap even further.

I'll try to have the generative comparisons for NB Pro up later this afternoon once I catch my breath.