[fumblebee]

If indeed, as the new benchmarks suggest, this is the new "top dog" of models, why is the launch feeling a little flat?

For comparison, the Claude 4 hacker news post received > 2k upvotes https://news.ycombinator.com/item?id=44063703

[johnfn]

Upvotes are a lagging indicator. Despite all the leaderboard scores presented, etc, no one actually knows how good a model is until they go use it for a while. When Claude 4 got ~2k upvotes, it was because everyone realized that Claude 3.7 was such a good model in practice - it had little to do with the actual performance of 4.

[v5v3]

Other AI companies post a 5 minute article to read.

This is a 50 minute long video, many won't bother to watch

[aprilthird2021]

Because the benchmarks are likely gamed. Also Grok had an extremely negative news cycle right before this, so the average bloke is skeptical that the smartest AI in the world thinks the last name Steinberg means someone is a shadowy, evil, cabal-type figure. Even though they aren't totally related, most people aren't deep enough in the weeds to know this

[typon]

Its a shame this model is performing so well because I can't in good conscience pay money to Elon Musk. Will just have to wait for the other labs to do their thing.

[brightfuturex]

I think it's a shame that your emotions are so much in your way. It's an illusion to think you can assess Elon at his true worth, like AI hallucinating due to lack of context.

[ceejayoz]

I'm not sure there's any benchmark score that'd make me use a model that suddenly starts talking about racist conspiracy theories unprompted. Doubly so for anything intended for production use.

[Ocha]

Nobody believes Elon anymore.

[fumblebee]

Hm, impartial benchmarks are independent of Elon's claims?

[bilsbie]

You can use a “formula” and make excel write offensive stuff too.

[mrtesthah]

Maligning any alternative viewpoints to yours as just some indoctrinated people following “marching orders”, rather than addressing the substance of their critique, constitutes a “poisoning the well” fallacy.

[mppm]

[flagged]

[Aerbil313]

Probably more like Claude was slightly better than GPT-xx when the IDE integrations first got widely adopted (and this was also the time where there was another scandal about Altman/OpenAI on the front page of HN every other week) so most programmers preferred Claude, then it got into a virtuous cycle where Claude got the most coding-related user queries and became the better coding model among SOTA models, which resulted in the current situation today.