News for hackers. Stuff that matters.
Re:Show HN: Off Grid – Run AI text, image gen, vision offlin... by wittlesus on Saturday February 14, 2026 @11:04PM (#47020948)
This is genuinely exciting. The fact that you're getting 15-30 tok/s for text gen on phone hardware is wild — that's basically usable for real conversations.

Curious about a couple things: what GGUF model sizes are practical on a mid-range phone (say 8GB RAM)? And how's the battery impact during sustained inference — does it drain noticeably faster than, say, a video call?

The privacy angle is the real killer feature here IMO. There are so many use cases (journaling, health tracking, sensitive work notes) where people self-censor because they know it's going to a server somewhere. Removing that barrier entirely changes what people are willing to use AI for.

Re:Show HN: Off Grid – Run AI text, image gen, vision offlin... by durhamg on Saturday February 14, 2026 @11:14PM (#47020996)
This sounds exactly like Claude wrote it. I've noticed Claude saying "genuinely" a lot lately, and the "real killer feature" segue just feels like Claude being asked to review something.
Re:Show HN: Off Grid – Run AI text, image gen, vision offlin... by ali_chherawalla on Saturday February 14, 2026 @11:12PM (#47020988)
I've added a section for recommended models. So basically you can chose from there.

I'd recommend going for any quantized 1B parameter model. So you can look at llama 3.2 1B, gemma3 1B, qwen3 VL 2B (if you'd like vision)

Appreciate the kind words!

Re:Show HN: Off Grid – Run AI text, image gen, vision offlin... by add-sub-mul-div on Saturday February 14, 2026 @11:11PM (#47020981)
> that's basically usable for real conversations.

That's using the word "real" very loosely.

Re:Show HN: Off Grid – Run AI text, image gen, vision offlin... by Terretta on Sunday February 15, 2026 @09:10AM (#47023795)
> The fact that you're getting 15-30 tok/s for text gen on phone hardware is wild — that's basically usable for real conversations.

Wild how bad it is compared to, say, Russet for iOS/ipadOS, which runs these same models at 110 tps.