[Papazsazsa]

"Opus 4.5 feels to me like"

The article is fine opinion but at what point are we going to either:

a) establish benchmarks that make sense and are reliable, or

b) stop with the hypecycle stuff?

[NewsaHackO]

>establish benchmarks that make sense and are reliable

How aren't current LLM coding benchmarks reliable?

[Papazsazsa]

They're manipulated.

[cardine]

> make sense and are reliable

If you can figure out how to create benchmarks that make sense, are reliable, correlate strongly to business goals, and don't get immediately saturated or contorted once known, you are well on your way to becoming a billionaire.