top | item 45183157

(no title)

pmx | 5 months ago

Frankly, I don't believe their claims that they don't degrade the models. I know we see models as less intelligent as we get used to them and their novelty wears off but I've had to entirely give up on Claude as a coding assistant because it seems to be incapable of following instructions anymore.

discuss

SparkyMcUnicorn|5 months ago

I'd believe a lot of other claims before believing model degradation was happening.

- They admittedly go off of "vibes" for system prompt updates[0]

- I've seen my coworkers making a lot of bad config and CLAUDE.md updates, MCP server span, etc. and claiming the model got worse. After running it with a clean slate, they redacted their claims.

[0] https://youtu.be/iF9iV4xponk?t=459