Hacker News Reader

My main concern with running LLMs locally so far is that it absolutely kills your battery if you're constantly inferencing.

It really does. On the other hand, if you have a power outlet handy, you can inference on the plane even without a net connection.