top | item 46650048

Show HN: Flag AI Slop in PRs

6 points| yatvij | 1 month ago |haystackeditor.com

Hi HN,

Lately Github PRs have been drowning in a flood of AI slop. I’ve been seeing it myself, and I’m not the only one: https://x.com/mitchellh/status/2011819428061855915

I think it’s great that folks are using AI tools to code faster and better, but too many folks are abusing them to make low-quality contributions to public repos. This takes a lot of reviewers’ mindshare.

IMO there needs to be a mechanism to flag low-effort PRs with AI slop, so you can just skip reading them. So I built one: https://haystackeditor.com/slop-detector

It’s a simple AI slop detector, and I also included some AI slop examples and a “Is it Slop or Not?” game for fun.

It detects AI messups like: - changes totally unrelated to PR purpose - hallucinated functions - duplicate code (specifically, when the AI re-implements a functionality that already exists elsewhere) - terrible comments

Would you use a tool like this?

1 comment

order

bradknowles|1 month ago

You should ask Daniel Stenberg of CURL fame. He might appreciate some help in this area.