[t_tsonev]

No fundamental reason not to power them with renewables, either off-grid or with a small capacity grid connection. The argument that they need to run at full load 24x7 sounds more like a business requirement than a technical one. LLMs in particular with their stateless nature seem like an ideal candidate for global distribution.

[trollbridge]

The capital cost of the AI hardware is high and it depreciates quickly, being worthless in 5 years (or less). To make a profit, it needs to be run 24/7.

It’s sort of like how airlines like to fly their airplanes as much as possible.