I have noticed that LLMs are actually pretty decent at redteaming code, so I’ve made it a habit of getting them to do that for code they generate periodically. A good loop is (a) generate code, (b) add test coverage for the code (to 70-80%) (c) redteam the code for possible performance/security concerns, (d) add regression tests for the issues uncovered and then fix the code.
ThailandJohn|5 months ago
If this was used before releasing the tea spill fiasco, only to name one? It would never have been a fiasco. Just saying..