[lobochrome]

“The quip about 98% correct should be a red flag for anyone familiar with spreadsheets”

I disagree. Receiving a spreadsheet from a junior means I need to check it. If this gives me infinite additional juniors I’m good.

It’s this popular pattern of HN comments - expect AI to behave deterministically correct - while the whole world operates on stochastically correct all the time…

[enneff]

In my experience the value of junior contributors is that they will one day become senior contributors. Their work as juniors tends to require so much oversight and coaching from seniors that they are a net negative on forward progress in the short term, but the payoff is huge in the long term.

[mat_b]

I don't see how this can be true when no one stays at a single job long enough for this to play out. You would simply be training junior employees to become senior employees for someone else.

[bluefirebrand]

Exactly this

And it should go without saying that LLMs do not have the same investment/value tradeoff. Whether or not they contribute like a senior or junior seems entirely up to luck

Prompt skill is flaky and unreliable to ensure good output from LLMs

[intended]

When my life was spreadsheets, we were expected to get to the point of being 99.99% right.

You went from “do it again” to “go check the newbies work”.

To get to that stage your degree of proficiency would be “can make out which font is wrong at a glance.”

You wouldn’t be looking at the sheet, you would be running the model in your head.

That stopped being a stochastic function, with the error rate dropping significantly - to the point that making a mistake had consequences tacked on to it.