[radq]

Not true, H100s cost $2-3/GPU/hr on the open market.

[menaerus]

Yes, they even do at $1/GPU/hr. However, 8xH100 cluster at full utilization is ~8kWh of electricity and costs almost ~0.5M$. 16xH100 cluster is probably 2x of that. How many years before you break-even at ~24$/GPU/day income?

[Jabbles]

7

https://www.google.com/search?q=0.5e6%2F8%2F24%2F365

[solidasparagus]

Who cares? That's someone else's problem. I just pay 2-3$/hr and the H100s are usable