top | item 47207605

(no title)

pluc | 12 hours ago

I can't wait until the AI people realize that without developers' original ideas, AI has nothing new to steal from. We don't create, AI will spit out the same old concepts. What, you're gonna create the next generation of AI by training it on what the very same AI has already produced? C'mon now.

You don't get technical creativity reflexes by using AI. This is technical stagnation in the making. By cannibalizing its own sources, AI is ensuring that future generations are locked-in subscription models to do the most basic technical tasks. This is all obvious, yet we speed up every chance we get.

discuss

order

dahart|12 hours ago

It might be a mistake to assume tomorrow’s training looks like today’s. Unsupervised learning is a thing and a very hot research topic, precisely because it avoids some of today’s big problems with acquiring the vast amounts of training data necessary.

greentea23|10 hours ago

Unsupervised leanring has been around for years and is already how the current wave of models are trained. It doesn't mean no data, it means no human provided labels of the data. So you still need creative new human ideas to move LLMs forward. LLMs != intelligence.

wolttam|11 hours ago

Maybe there aren’t that many new/necessary ideas that can be mined from the fundamental building blocks of software development (languages, syntax, runtimes, static analyses, type checking, etc). Maybe people will continue to innovate by instructing models to build novel things out of those building blocks? Perhaps things we would not have thought of building before due to the effort required without LLM assistance.

andersmurphy|7 hours ago

It's the opposite. The less competent the average developer the more valuable coding LLMs become (as the only way for those bad developers to generate ok code). Eliminate the good developers and even bad coding LLMs become valuable.

fdgg|2 hours ago

Hey man is there a private space where thinkers like you hang? Would like to join :)

I wrote a similar post in this thread.

microgpt|12 hours ago

I don't expect them to realise that until some time after it actually happens. When it remains a future hypothetical, it won't be accounted for.

PetoU|12 hours ago

fwiw 90% of software is reinventing the wheel. 80% of devs have an itch to "rewrite from scratch".

AI will deduplicate all of this

debone|12 hours ago

My experience is that 100% of AI devs are reinventing the wheel, most of the time for no better reason than "I can do it" or "not invented here"

pluc|12 hours ago

This is fine. How else do you learn but by taking things apart and rebuilding them? This obsession with productivity is incompatible with onboarding new talent. Having 1000 versions of the same concept is exactly what progress is.

sunir|12 hours ago

Why would there be a lack of original ideas? People who are born to code so to speak will do it. Information wants to be free as the saying goes. It only takes one time for an innovation for it to be to copied everywhere.

We don’t need the same volume of developers to have the same or faster speed of innovation.

And conversely if there is stagnation there is a capital opportunity to out compete it and so there will be a human desire to do the work.

Tl;Dr. People like doing stuff and achieving. They will continue to do stuff.

ps it’s too much to claim other people don’t experience creative ideas using AI. You don’t really know that’s true. It hasn’t been my experience as I have had the capability and capacity to complete ideas on my back burner for decades and move onto the next thing.

hluska|12 hours ago

That’s the big scary point at the crux of all of this - you’ve had decades without the tooling to develop instincts. Nobody knows whether it’s possible to develop instincts with the tooling or what those instincts will look like. Creativity takes a degree of skill to execute on and the concern is that we’re potentially graduating people to painting the ceiling of the Sistine chapel before they’ve even learned to sketch.

At minimum, our current generation of leaders will have to get much better at managing resources and building people up. We have to up our games and build environments where the pursuit of deep understanding is permissible. Unfortunately with the current hiring issues, it’s totally understandable that young developers are scared to take time on tickets.

EGreg|12 hours ago

It isn’t about training anymore. It is about harnesses.

Just look at new math proofs that will come out, as one example. Exploration vs Exploitation is a thing in AI but you seem to think that human creativity can’t be surpassed by harnesses and prompts like “generate 100 types of possible…”

You’re wrong. What you call creativity is often a manual application of a simple self-prompt that people do.

One can have a loop where AI generates new ideas, rejects some and ranks the rest, then prioritizes. Then spawns workloads and sandboxes to try out and test the most highly ranked ideas. Finally it accretes knowledge into a relational database.

Germans also underestimated USA in WW2, saying their soldiers were superior, and USA just had technology — but USA out produced tanks and machinery and won the war through sheer automation, even if its soldiers were just regular joes and not elite troops.

Back then it was mechanized divisions. Now it is mechanized intelligence.

While Stalin said: Quantity has a quality all its own.

pluc|12 hours ago

There is no "new ideas" with AI. Claiming the opposite is a fundamental misunderstanding of the technology.

estimator7292|11 hours ago

Innovation is irrelevant to pushing up this quarter's numbers. No one actually values unique and novel ideas. The only thing that matters is shipping something right now that can make an impact on this quarter's numbers.

Who cares if it's derivative slop or a straight up bootleg of something else so long as the number goes up

skeledrew|11 hours ago

Technically all the problems that almost any given business needs to be solved today has already been solved umpteen times over the years. There are no new problems that can't be solved by porting and/or combining old solutions.

lioeters|10 hours ago

"Everything has already been invented." - Some 19th-century scientist who had no imagination to see the wave of technological innovation that was coming.

pluc|11 hours ago

That's the literal definition of stagnation. That is not compatible with growth.

Also that's not a new idea, that "everything worth inventing/exploring has already been". It's precisely what AI reinforces, and that goes against human nature (and capitalism) as that statement has historically proved.