When I work side-by-side with Claude to fix bugs or ask it to fix problems. It constantly makes mistakes, like the other day it got the concept of batchItemFailures on an sqs queue completely wrong.
How are people just firing them off to build stuff with any confidence?
One might argue it should know others codebases though. The fact it wouldn’t know function signatures for AWS SDK isn’t hugely promising and reflects my own experiences using LLMs
eisbaw|7 months ago
AI won't magically know your codebase unless it is pretty vanilla - but then you teach it. If it makes a mistake, teach it by adding a rule.
You have to confine the output space or else you quickly get whatever.
thatscot|7 months ago
deanc|7 months ago