[saberience]

Verifying the code means, does it actually do what you said it does?

When you vibe code things, the AI often thinks it built something that does X, but when you actually test it/verify it, in fact it doesn't do that at all.

I've seen it this week with both Codex and Claude Code. I built something for scraping financial data from various websites. Claude Code said, yes I built this and it works. I verified the data and it wasn't accurate, it was data for the previous quarter.

I.e. if you're trusting that the AI built your RAG perfectly without testing it, you're probably mistaken.

[zcw100]

"I took a look" is the human version of vibe coding.