[mattmanser]

You've missed the subtlety here.

LLMs don't have attention to detail.

This project had extremely comprehensive, easily verifiable, tests.

So the LLM could be as sloppy as they usually arez they just had to keep redoing their work until the code actually worked.

[selridge]

I missed the subtlety?

I linked the paper! I read the paper. Yeah. they wrote the tests, which is how this worked! how the heck do you think it was supposed to work?

the fact that they needed to write the tests was just the means to implementation. It didn't change the non-LLM labor economics of the problem.

[mattmanser]

No, I meant subtlety of definition, you've attributed the diligence to the LLM when in fact it's the tests that provide that.

You've unfortunately committed the big sin of anthropomorphizing the LLM and calling it diligent.

An LLM cannot be diligant, it's stochastic so it's literally impossible for it to be diligant.

Writing all those tests was diligant.

[salawat]

Who wrote the tests?

[bigbuppo]

The meat wrote the tests. As I've been telling you, they're made out of meat.

[selridge]

And how does the answer to your question bear on the claim I’m making?