I think it's already happening. I've been using Claude a lot since 3.5. For a while, I barely bothered to check what it was doing because the code it generated tended to be fairly straightforward and usually worked on the first try. But in the last few weeks, I've started reading everything line by line again, because now it's not only often incorrect but also written in a goofy, convoluted way. AI-generated code being constantly fed back to it in a feedback loop would explain a lot, I think.
nyarlathotep_|10 months ago
Things like a loss of context about the nature of some installed dependency or something.
You really have to know what you're doing and read carefully to avoid glossing over things that'll catch up to you later.
ffsm8|10 months ago
The cutoff date for Claude 3.5 is April 2024, that's currently slightly over one year ago.