[ginvok]

On my own experience, LLMs are great to speed up boilerplate and test cases (note 1). And the closer you are to the business the more it become less useful (e.g. I used to work in an insurance company and it insisted to sum interests or taxes on some payments by hallucinating variables) Note 1: On tests written by juniors it helped us to have much more tests, but did not improve their quality, llms have no way to measure coverage so it would just generate "cleaver" edge cases (NaN, and infinities even though theses cases were already caught by another place in the code), because the juniors would just accept any code recommendations from llms. Seniors on the other hand would only accept tests they wrote good descriptions for... Were the seniors fast? Yeah, they even enjoyed writing tests now. But reviews were a lot more about catching useless cases. And yeah, I'm aware tests are not only about coverage, but it is one of the concerns we had.