Show HN: Cactus – Ollama for Smartphones

Re:Show HN: Cactus – Ollama for Smartphones by matthewolfe on Thursday July 10, 2025 @04:35PM (#44525273)

For argument's sake, suppose we live in a world where many high-quality models can be run on-device. Is there any concern from companies/model developers about exposing their proprietary weights to the end user? It's generally not difficult to intercept traffic (weights) sent to and app, or just reverse the app itself.

[ Parent | on HN ]

Re:Show HN: Cactus – Ollama for Smartphones by rshemet on Thursday July 10, 2025 @04:48PM (#44525425)

So far, our focus is on supporting models with fully open-sourced weights. Providers who are sensitive about their weights typically lock those weights up in their cloud and don't run their models locally on consumer devices anyway.

I believe there are some frameworks pioneering model encryption, but i think we're a few steps away from wide adoption.

[ Parent | on HN ]

Re:Show HN: Cactus – Ollama for Smartphones by bangaladore on Thursday July 10, 2025 @05:48PM (#44525998)

Simple answer is they won't send the model to the end user if they don't want it used outside their app.

This isn't really anything novel to LLMs of AI models. Part of the reason for many previously desktop applications being cloud or requiring cloud access is keeping their sensitive IP off the end users' device.

[ Parent | on HN ]