What does verifying code by hand even mean? Do we now have artisanal testing, lovingly hand crafted? I get the current debate about LLM assisted coding but this is mudslinging and not constructive discussion.
Verifying the code means, does it actually do what you said it does?
When you vibe code things, the AI often thinks it built something that does X, but when you actually test it/verify it, in fact it doesn't do that at all.
I've seen it this week with both Codex and Claude Code. I built something for scraping financial data from various websites. Claude Code said, yes I built this and it works. I verified the data and it wasn't accurate, it was data for the previous quarter.
I.e. if you're trusting that the AI built your RAG perfectly without testing it, you're probably mistaken.
saberience|10 days ago
When you vibe code things, the AI often thinks it built something that does X, but when you actually test it/verify it, in fact it doesn't do that at all.
I've seen it this week with both Codex and Claude Code. I built something for scraping financial data from various websites. Claude Code said, yes I built this and it works. I verified the data and it wasn't accurate, it was data for the previous quarter.
I.e. if you're trusting that the AI built your RAG perfectly without testing it, you're probably mistaken.
zcw100|9 days ago