News for hackers. Stuff that matters.
Re:Experimenting with Local LLMs on macOS by jerryliu12 on Monday September 08, 2025 @01:25PM (#45171086)
My main concern with running LLMs locally so far is that it absolutely kills your battery if you're constantly inferencing.
Re:Experimenting with Local LLMs on macOS by seanmcdirmid on Monday September 08, 2025 @03:56PM (#45173128)
It really does. On the other hand, if you have a power outlet handy, you can inference on the plane even without a net connection.