[smallerfish]

> Most of the tests are BS too.

Only if you don't constrain the tests. If you use agents adversarially in generating test cases, tests and review of results, you can get robust and tight test cases.

Unless you're in research, most of what we do in our day jobs is boilerplate. Using these tools is not yet foolproof, but with some experience and experimentation you can get excellent results.

[lazide]

I don’t have to do boilerplate, generally.

And with all the stacking LLMs against each other, that just sounds like more work than just… writing the damn tests.

[smallerfish]

> I don’t have to do boilerplate, generally.

I meant this more in the sense of there is nothing new under the sun, and that LLMs have been trained on essentially everything that's available online "under the sun". Sure, there are new SaaS ideas every so often, but the software to produce the idea is rarely that novel (in that you can squint and figure out roughly how it works without thinking too hard), and is in that sense boilerplate.