top | item 45185475

(no title)

My experience is similar. At first Claude was super smart and get even very complicated things right. Now even super simple tasks are almost impossible to finish right, even if I really chop things into small steps. Also it's much slower even on Pro account than a few weeks ago.

discuss

strictnein|5 months ago

I'm on the $200 / month account and its also slower than a few weeks ago. And struggling more and more.

I used to think of it as a decent sr dev working alongside me. Not it feels like an untrained intern that takes 4-5 shots to get things right. Hallucinated tables, columns, and HTML templates are its new favorite thing. And calling things "done" that aren't even half done and don't work in the slightest.

brookst|5 months ago

Same plan, same experience. Trying to get it to develop and execute tests and it frequently modifies the test to succeed even if the libraries it calls fail, and then explains that it’s doing so because the test itself works but the underlying app has errors.

Yes, I know. That’s what the test was for.

keyle|5 months ago

There must be a term coined for AI degradation...

At least with local LLM, it's crap, but it's consistent crap!

cyanydeez|5 months ago

Gotta assume theyre reducing overall compute with smaller models cause 200$ aint squat for their investment.

insane_dreamer|5 months ago

On Max and also find it slower recently.

Also yesterday tried to use it to debug some AWS issue and it tried to send me down so many wrong paths, and suggested changes that were either plain wrong or had unintended consequences, that if I didn't actually know my stuff and had followed blindly, the results would have been pretty bad or at least a huge time waster. When I called it out it would quickly reverse course ("You're right of course!") and it did provide some helpful snippets but I was unimpressed.

What I find it excellent at is for throw-away scripts to do small jobs or automate little things--stuff I could do but would take me a lot longer (especially in bash).

ranguna|5 months ago

It's still pretty good on my side. I'm just paying for the pro version.