News for hackers. Stuff that matters.

skye0110

Ask HN: Are third party gguf/mmproj safe on Llama in production env

So i had been building a side project screenmind ,sort of local ai desktop assistant, and hit a confusing multimodel failure...texts worked,but vision and image failed no crash just returning <unsused49>. i narrowed it down to unsloths gemma 4 gguf +mmproj broke on llama(atleast thats my hypothesis , feel free to correct me) b10244, and the fix was to just switch to ggml.So is pinning...

( Read More... | no comments | 2 points | on HN )
thats the nice part though-not everything has to be a moat , anyone can build what they think , no idea remains a idea thats a win.

Show HN: Local privacy-first Microsoft Recall alternative with Gemma 4

https://github.com/ayushh0110/ScreenMind/blob/main/README.md

hi author here, Screenmind is privacy first Microsoft recall alternative . It runs on gemma 4 which is one of the fewer models supporting vision audio and reasoning all 3, so your data never leaves you machine.With screenmind you can keep a track of your timeline , how much time you spent on what..search any screenshot with any text on it.. and the coolest thing, you can chat with your screen...

( Read More... | 2 comments | on HN )
agreed, the backlash was the cloud + always-on , not the idea itself. thats basically why i only bothered building the local version.
thats the point - local, opt-in, nothing leaves the machine. rewind was great but the cloud part scared people off. this runs the whole analysis on-device so the search/chat works without anything being uploaded and it works more as a background service.