Ask HN: Why are desktop AI apps so heavy?
I mean they are text apps basically, they should be flying on modern PCs that can do close to a trillion ops per second. Inference is done elsewhere, so what's the deal?
I mean they are text apps basically, they should be flying on modern PCs that can do close to a trillion ops per second. Inference is done elsewhere, so what's the deal?
Hey HN,I’m Yannis, co-founder of Preloop. We’ve built a proxy for the Model Context Protocol (MCP) that lets you add human approval gates to your AI agents without changing your agent code.We’re building agents that use tools (Claude Desktop, Cursor, etc.), but we were terrified to give them write-access to sensitive systems (Stripe, Prod DBs, AWS). We didn't want to rewrite our agents to wrap...
Yea, but you still have to read them, i.e. focus this "machinery" on a single word/sentence. So you're working in sequence when trying to identify a bunch of unrelated labels. On the contrary, you can probably differentiate an entire group of icons just by a glance in their direction (provided they are appropriately designed, of course).
Plus reading speed is pretty much the same no matter how many times you repeat the task. Recognition on the other hand improves with repetition.
If you're using only text, you're pretty much stuck with being able to differentiate your icons either by location or by actually reading them. Icons add another component to this.
Totally agree with the color-related comment though.
IANANS btw, so your mileage may vary.
"Marcus has a point - even is some of what is said about deep neural networks is incorrect (for instance, they can learn and generalize from very few example, one shot learning).
However, he got it wrong with the answer. The key for machines to reach the symbolic abstraction level is the way we train them. All training algorithms, supervised, unsupervised or reinforcement learning with LSTM rely on the assumption that there is an "utility function" imposed by some external entity. Problem is, by doing so, we are taking away their capacity [of the machines] to make questions and create meaning.
The most important algorithm for learning is "meaning maximization" not utility maximization. The hard part is that we cannot define what is meaning - maybe we can't, I'm not sure. That is something I will be glad to discuss."
When design is about cramming some animation in just about everything you can show on the screen, and about how fancy your colors are going to be – yes, I agree, it's relatively unimportant.
But real design is not about that at all. In fact, functionality has been part of the core debate in design, for at least a century now. Ask any designer – not only the ones dealing with UI, and they'll tell you.
I'm wondering how helpful could that be in prediction though? Would it actually help if I wish to predict how many upvotes my headline would get, and I add my karma as a feature? I think in fact such features would degrade generalisation performance, as they stand in like placeholders (when training), i.e. high karma users are correlated to higher probability for a "hit story".