[frithsun]

I believe this is a "good" bubble in the sense that the 19th century railroad bubble and original dot com bubble both ended up invested in infrastructure that created immense value.

That said, all of these LLMs are interchangeable, there are no moats, and the profit will almost entirely be in the "last mile," in local subject matter experts applying this technology to their bespoke business processes.

[bjornnn]

America's railroad boom isn't a great example, it got us the worst rail infrastructure in the world, built by private monopolies solely for maximum short-term profit, i.e. moving freight and not passengers, and now American industry is largely gone and we're stuck with rail infrastructure that is useless to almost everyone and it costs far more to maintain it than it's even worth.

America's internet infrastructure, like the railroads, was also left in the hands of private monopolies and it is also a piece of shit compared to other countries. It's slow and everyone pays far too much for it and many are still excluded from it because it's not profitable enough to run fiber to their area.

The AI bubble won't leave behind any new infrastructure when it bursts. Just millions of burned out GPUs that get sent to an e-waste processing plant where they are ground up into sand, trillions of dollars wasted, many terawatt hours of energy wasted, many billions of liters of freshwater wasted, and the internet being buried under an avalanche of pseudorandomly-generated garbage.

[dinkblam]

> "good" bubble in the sense

how can massively buying hardware that will have to be thrown away in a few years be a "good" bubble in the sense of being a lasting infrastructure investment?

[falcor84]

Why would that hardware "have to be thrown away"? I've seen quite old GPUs still in use; given the current demand, I expect the vast majority of hardware used in these data centers to see a lot more extended use than most other types of electronics around the world (e.g. phones).

[entropi]

I am pretty optimistic that as long as hardware capacity exists, people will find ways of using it. Whether it will be profitable or not is another story of course.

[benterix]

The prices are falling down. I do a lot of Machine Learning and sometimes work with large datasets. The ability to (1) put all data in VRAM and (2) have the results in hours/days instead of weeks is amazing - and in the past it wouldn't be easy for a normal researcher like me. Now I can have access to these beefy machines, do my research and publish the results without taking a loan from my bank.

[h3lp]

One large but forgotten effect of the dotcom bubble was an excess fiber capacity, that allowed smooth growth of internet in the following 25 years---average internet speed in the US is 200 Mbps, and a significant number of households is on a gigabit uplink. I take your point that GPU hardware amortizes away faster than fiber, but that's true of all computing hardware: the average lifecycle of a server is around five years.

[schnable]

The models themselves, and methods and knowledge used to build and use them, are part of the "infrastructure" being built.

[illiac786]

Completely agree. I would ask also what “infrastructure” the dotcom bubble created?

[Zigurd]

All over rural New England you'll find abandoned rail lines. Many of these were used for passenger service between walkable towns. Now, Boston area commuter rail sucks big time. Towns now have commercial stips "served" by cars-only "stroads."

How well used do you think those AI data centers are going to be?

[miltonlost]

Ok, but what's the infrastructure that will remain after the AI bubble that can be retooled like railroads or dot com?

[queenkjuul]

Maybe we'll all be able to afford secondhand H100s and finally get to see raytraced cyberpunk at 4k120

[wulfstan]

I keep saying to people - "if you have a good idea that can make use of large amounts of really really cheap GPUs to do something genuinely useful - get ready for a massive glut of spare capacity". I still haven't thought of anything, unfortunately...

[bee_rider]

These are sort of compute-focused GPUs, right? I bet a lot of university labs would like them.

I wonder if ubiquitous, user-friendly finite elements analysis tools could become a boon for 3D printers.

[variadix]

Hopefully they can be repurposed for something like cheap drug discovery rather than shitcoin mining.

[amlib]

I would love to build a render farm out of cheap decommissioned GPUs...

[0x000xca0xfe]

I hope it will bring us reliably good memory bandwidth in consumer devices, an area where many hardware vendors are skimping.