Great article. If this sustainable arbitrage exists from renting gpu time instead of selling and shipping gpus, why doesn't nvidia become a cloud provider itself?
Why are Ford and Enterprise Rentacar different companies?
(ok, this does actually require a substantial amount of business theory to explain, but the shorthand is "core competence". And different risk profiles.)
Simple, because Nvidia can charge twice for the same GPU that way.
Building a cloud data center is cost first and then you earn money by rent.
But if you seel the GPU to a CSP then the cloud provider has the cost and needs to rent while you made immediately money on the GPU.
But what about getting paid continously? Well simple, the end customer is then cloud but the cloud customer. So develop a SW for your GPU which then has a license to it. So the end cloud customer will pay rent to the cloud provider and license fee to the GPU maker. That's Nvidia's business model for now.
Eventually, the demand for GPU sales will drop but by that time, Nvidia will have a large install base of end customers using their enterprise SW. Then Nvidia will start becoming a competitior to CSPs and will easily do so because they can deploy data centers at cost and give better pricing. But today, Nvidia needs the CSPs to spread their SW. The primary goal is to reach all the end customer via DGX cloud and to create mindshare and moats. CSPs are only a means to an end of Nvidia as they could easily out compete them on AI compute if Nvidia wanted to to.
Why doesn't every chip vendor pull a reverse-Apple and replace all the OEMs in the value chain?
They don't do this because they'll annoy all those folks they're trying to replace (see also 3dfx's move from selling chips to being a card vendor as precedent), and have to build a whole set of skills, relationships, and infrastructure they don't have, and there's risk involved in all of that.
See also why didn't nVidia (and any other GPU vendor) just mine cryptocurrency instead of selling cards during the last boom.
They're hiring for roles that look like cloud and infrastructure engineers- although that may be for internal infrastructure for training their models.
It's not an impossibility that they could eventually do that - but it would be very difficult for them to do for a number of reasons that other folks have listed.
Bitmain, a manufacturer of bitcoin mining hardware, was using their machines to mine bitcoin before eventually shipping them to customers.
This was a horrible business practice that they got called out heavily on. When I was mining Litecoin, we received a bunch of units that were obviously used. They would claim they were being "tested" first... uh huh.
It's not a risk-free investment, you're basically making a bet on future GPU demand. If demand dips, you're left with a bunch of hardware gathering dust (or no longer operating at a profit).
pjc50|1 year ago
(ok, this does actually require a substantial amount of business theory to explain, but the shorthand is "core competence". And different risk profiles.)
dazc|1 year ago
Der_Einzige|1 year ago
htrp|1 year ago
DGX Cloud exists --- Nvidia sells the GPU to a hyperscaler and then builds a cloud on top of it and charges a markup.
Get's paid twice
Jlagreen|1 year ago
Building a cloud data center is cost first and then you earn money by rent.
But if you seel the GPU to a CSP then the cloud provider has the cost and needs to rent while you made immediately money on the GPU.
But what about getting paid continously? Well simple, the end customer is then cloud but the cloud customer. So develop a SW for your GPU which then has a license to it. So the end cloud customer will pay rent to the cloud provider and license fee to the GPU maker. That's Nvidia's business model for now.
Eventually, the demand for GPU sales will drop but by that time, Nvidia will have a large install base of end customers using their enterprise SW. Then Nvidia will start becoming a competitior to CSPs and will easily do so because they can deploy data centers at cost and give better pricing. But today, Nvidia needs the CSPs to spread their SW. The primary goal is to reach all the end customer via DGX cloud and to create mindshare and moats. CSPs are only a means to an end of Nvidia as they could easily out compete them on AI compute if Nvidia wanted to to.
andy_ppp|1 year ago
sevagh|1 year ago
zdw|1 year ago
They don't do this because they'll annoy all those folks they're trying to replace (see also 3dfx's move from selling chips to being a card vendor as precedent), and have to build a whole set of skills, relationships, and infrastructure they don't have, and there's risk involved in all of that.
See also why didn't nVidia (and any other GPU vendor) just mine cryptocurrency instead of selling cards during the last boom.
dharmab|1 year ago
unstatusthequo|1 year ago
rybosworld|1 year ago
Bitmain, a manufacturer of bitcoin mining hardware, was using their machines to mine bitcoin before eventually shipping them to customers.
latchkey|1 year ago
Retr0id|1 year ago
unknown|1 year ago
[deleted]
mehulashah|1 year ago
latchkey|1 year ago