top | item 44637877

(no title)

ekojs | 7 months ago

> Btw as an aside, we didn’t announce on Friday because we respected the IMO Board's original request that all AI labs share their results only after the official results had been verified by independent experts & the students had rightly received the acclamation they deserved

> We've now been given permission to share our results and are pleased to have been part of the inaugural cohort to have our model results officially graded and certified by IMO coordinators and experts, receiving the first official gold-level performance grading for an AI system!

From https://x.com/demishassabis/status/1947337620226240803

Was OpenAI simply not coordinating with the IMO Board then?

discuss

order

thegeomaster|7 months ago

Yes, there have been multiple (very big) hints dropped by various people that they had no official cooperation.

osti|7 months ago

I think this is them not being confident enough before the event, so they don't wanna be shown a worse result than competitors. By being private they can obviously not publish anything if it didn't work out.

esafak|7 months ago

They shot themselves in the foot by not showing the confidence that Google did.

ml-anon|7 months ago

As not-so-subtly hinted at by Terry Tao.

Its a great way to do PR but its a garbage way to to science.

pphysch|7 months ago

This reminds me of when OpenAI made a splash (ages ago now) by beating the world's best Dota 2 teams using a RL model.

...Except they had to substantially bend the rules of the game (limiting the hero pool, completely changing/omitting certain mechanics) to pull this off. So they ended up beating some human Dota pros at a psuedo-Dota custom game, which was still impressive, but a very much watered-down result beneath the marketing hype.

It does seem like Money+Attention outweigh Science+Transparency at OpenAI, and this has always been the case.

NitpickLawyer|7 months ago

Limiting the hero pool was fair I'd say. If you can prove RL works on one hero, it's fairly certain it would work on other heroes. All of them at once? Maybe run into problems. But anyway you'd need orders of magnitude more compute so I'd say that was fair game.

dmitrygr|7 months ago

> Was OpenAI simply not coordinating with the IMO Board then?

You are still surprised by sama@'s asinineness? You must be new here.

antonvs|7 months ago

When your goal is to control as much of the world's money as possible, preferably all of it, then everyone is your enemy, including high school students.

MisterPea|7 months ago

I am still surprised many people trust him. The board's (justified) decision to fire him was so awfully executed that it lead to him having even more slack