[attemptone]

>I feel the opposite, and pretty much every metric we have shows basically linear improvement of these models over time.

Wait, what kind of metric are you talking about? When I did my masters in 2023 SOTA models where trying to push the boundaries by minuscule amounts. And sometimes blatantly changing the way they measure "success" to beat the previous SOTA

[mountainriver]

Almost every single major benchmark, and yes progress is incremental but it adds up, this has always been the case

[attemptone]

We were talking about linear improvements and I have yet to see it