[jkelleyrtp]

claude swe-bench is 80.8 and codex is 56.8

Seems like 4.6 is still all-around better?

[gizmodo59]

Its SWE bench pro not swe bench verified. The verified benchmark has stagnated

[joshuahedlund]

Any ideas why verified has stagnated? It was increasing rapidly and then basically stopped.

[Rudybega]

You're comparing two different benchmarks. Pro vs Verified.