[Ologn]

Cisco stock (which I thought about buying in 1992 and didn't, unfortunately) doubled in 1990, tripled in 1991, doubled in 1992, and kept going up every year - in 1995 it doubled, in 1998 it doubled, in 1999 it doubled. So it had a long run (and is also still worth over $250 billion).

The monetary push is very LLM based. One thing being pushed that I am familiar with is LLM assisted programming. LLMs are being pushed to do other things as well. If LLMs don't improve more, or if companies don't see the monetary benefits of using them in the short/medium term, that would drag Nvidia down.

Nvidia has a lot of network effects. Probably only Google has some immunity to that (with its TPUs). I doubt Nvidia will have competition in training LLMs for a while. It is possible a competitor could start taking market share on the low end for inference, but even that would take a while. People have been talking about AMD competition for over two years, and I haven't seen anything that even seems like it might have potential yet, especially on the high end.

[ra7]

There's a lot of push for inference hardware now (e.g. Ironwood TPUs). How does Nvidia maintain an edge there?

Also, I think the market has to expand beyond LLMs to areas like robotics and self driving cars (and they need to have real success) for Nvidia to maintain this valuation. I don't think only LLMs are enough because I don't see code assist/image generation/chatbots as a massive market.

[Jlagreen]

That's because Nvidia is offering a full ecosystem stack with HW, SW and networking clusters.

And that gives customers the most flexibility. Nvidia dominates training and is highly competitive in inferencing. At the same time, SW improvements speed up single node and networking performance. H100 released 3 years ago is today several times faster than it was on release with constant SW updates.

Customers who buy Nvidia for training today can use the older GPUs from Nvidia for inferencing later. And Nvidia supports even V100 still in SW updates and speed improvements. And since all is based on the same SW ecosystem, it allows for more seamless operations for customers. You can mix different Nvidia GPU clusters but you can't easily mix Nvidia solutions with other solutions.

That is also why Nvidia has always been dominant and that's flexibility. NVFP4 is a good example of what they do to stay ahead. And it is even supported by Hopper so any old customer can use Nvidia's new format to further improve model training performance. Suddenly old Hopper clusters become more valuable with some SW releases by Nvidia.

Nvidia has a track record which no competitor can match. Going with Nvidia is no mistake today while going with any competitor is a risky bet. If you spend billions, you think twice about making bets.