[JaggerFoo]

I did this with Claude over the holidays. Putting Claude in the role as a guesser and comparing the guess to another experience human player. It turns out they both matched each other.

[suveen_ellawela]

That's a nice experiment! I think codenames could definietly be an evaluation method for LLMs.

[pieix]

Elo on different card games/board games would be a great eval metric now that the systems are general enough to play Codenames, chess, poker…

[__MatrixMan__]

It would be fun to build one, perhaps mediated by an app, where you have to guess whether your spymaster is a human or an AI based on the quality of their choices.