News for hackers. Stuff that matters.
Re:Pocket LLM Server Just Like a Pocket WiFi by yamatokaneko on Wednesday July 09, 2025 @03:49AM (#44507312)
I think it’s a very interesting approach. Could be for a niche group, likely power users of LLMs who are often mobile and value privacy.

Any thoughts on how small this hardware could eventually become?

Re:Pocket LLM Server Just Like a Pocket WiFi by itstomo on Tuesday July 15, 2025 @10:14PM (#44578033)
Looks like the hardware needed to run state-of-the-art open source LLM will be ~100kg... haha It's not feasible today. Someday!