top | item 45717557

(no title)

weavejester | 4 months ago

"I’m not sure if anyone else feels this way, but with the introduction of generative AI, I don’t find coding fun anymore. It’s hard to motivate myself to code knowing that a model can do it much quicker. The joy of coding for me was literally the process of coding."

I experimented with GPT-5 recently and found its capabilities to be significantly inferior to that of a human, at least when it came to coding.

I was trying to give it an optimal environment, so I set it to work on a small JavaScript/HTML web application, and I divided the task into small steps, as I'd heard it did best under those circumstances.

I was impressed overall by how far the technology has come, but it produced a number of elementary errors, such as putting JavaScript outside the script tags. As the code grew, there was also no sense that it had a good idea of how to structure the codebase, even when I suggested it analyze and refactor.

So unless there are far more capable models out there, we're not at the stage where generative AI can match a human.

In general I find current model to have broad but shallow thinking. They can draw on many sources, which is extremely useful, but seem to have problems reasoning things through in depth.

All this is to say that I don't find the joy of coding to have gone at all. In fact, there's been a number of really thorny problems I've had to deal with recently that I'd love to have side-stepped, but due to the currently limitations of LLMs I had to solve them the old-fashioned way.

discuss

order

Finbel|4 months ago

It's so strange. I do all the things you mention and it works brilliantly well 10 times out of 11.

EagnaIonat|4 months ago

You are probably doing something others have done before frequently.

I find the LLMs struggle constantly with languages there is little documentation or out of date. RAG, LoRA and multiple agents help, but they have their own issues as well.

wseqyrku|4 months ago

> and found its capabilities to be significantly inferior to that of a human, at least when it came to coding.

I think we should step back and ask: do we really want that? What does that imply? Until recently nobody would use a tool and think, yuck, that was inferior of a human.

CamperBob2|4 months ago

I experimented with GPT-5 recently

GPT-5 what? The GPT-5 models range from goofily stupid to brilliant. If you let it select the model automatically, which is the case by default, it will tend to lean towards the former.

weavejester|4 months ago

I was using GitHub Copilot Pro with VS Code, and the agent was labelled "GPT-5". Is this a particularly poor version of the model?

I also briefly tried out some of the other paid-for models, but mostly worked with GPT-5.