[Eupolemos]

Why are you talking price when we are talking local AI?

That doesn't make any sense to me. Am I missing something?

[dirasieb]

15 missed calls from your local power company

[culi]

Your electricity is free?

[seanmcdirmid]

Apple silicon is crazy efficient as well as being comparable to GPUs in performance for max and ultra chips.

[cpburns2009]

If you have the hardware to run expensive models, is the cost of electricity much of a factor? According to Google, the average price in the Silicon Valley Area is $0.448 per kWh. An RTX 5090 costs about $4,000 and has a peak power consumption of 1000 W. Maxing out that GPU for a whole year would cost $3,925 at that rate. It's not particularly more expensive than that hardware itself.

[thot_experiment]

for almost the entire year, yes.