[mbowcut2]

I'm not surprised. People really thought the models just kept getting better and better?

[segmondy]

The models are getting better and better.

[giveita]

That's expected. No one will release a worse model.

[guerrilla]

Maybe. How would I know?

[jMyles]

...even if the agent did "cheat", I think that having the capacity to figure out that it was being evaluated, find the repo containing the logic of that evaluation, and find the expected solution to the problem it faced... is "better" than anything that the models were able to do a couple years ago.