top | item 46277067

Show HN: ModelGuessr: Can you tell which AI you're chatting with?

6 points| mdahardy | 2 months ago |model-guessr.com

Hey HN - I built ModelGuessr, a game where you chat with a random AI model and try to guess which one it is.

A big open question in AI is whether there's enough brand differentiation for AI companies to capture real profits. Will models end up commoditized like cloud compute, or differentiated like smartphones?

I built ModelGuessr to test this. I think that people will struggle more than they expect. And the more model mix-ups there are, the more commodity-like these models probably are.

If enough people play, I'll publish some follow-up analyses on confusion patterns (which models get mistaken for each other, what gives them away, etc.). Would love any feedback!

2 comments

order

twelvechess|2 months ago

I tried this. Its cool but when you guess correct it allows you to click another model and doesnt refresh the page to try again with another model or sth.

mdahardy|2 months ago

Ah, nice idea. I hadn't considered locking it after you guess correctly.