[jerryliu12]

My main concern with running LLMs locally so far is that it absolutely kills your battery if you're constantly inferencing.

[seanmcdirmid]

It really does. On the other hand, if you have a power outlet handy, you can inference on the plane even without a net connection.