top | item 44977857

(no title)

jmvldz | 6 months ago

I don't have a ton of tests. From what I've seen, Claude will often just update the tests to no-op so tests passing isn't trustworthy.

My workflow is often to plan with ChatGPT and what I was getting at here is ChatGPT can often hallucinate features of 3rd party libraries. I usually dump the plan from ChatGPT straight into Claude Code and only look at the details when I'm testing.

That said, I've become more careful in auditing the plans so I don't run in to issues like this.

discuss

order

CuriouslyC|6 months ago

Tell Claude to use a code review sub agent after every significant change set, tell them to run the tests and evaluate the change set, don't tell Claude it wrote the code, and give them strict review instructions. Works like a charm.

jmvldz|6 months ago

Interesting. I had not thought about a code review sub agent. I will give that a shot.

cpursley|6 months ago

Any tips on writing productive review sub agent instruction?