wer232essf
The point about Apple’s Neural Engine is really interesting. It feels like such a missed opportunity that Core ML isn’t fully leveraging the ANE for transformer workloads yet. Instead, everything ends up running through the GPU, which works but isn’t nearly as efficient. A proper mapping layer from Core ML to the ANE could make a massive difference in performance and battery life.
For anyone curious, Apple does have some developer notes on Core ML and Metal performance here: https://developer.apple.com/documentation/coreml. It doesn’t go as deep as most of us would like, but it shows how tightly controlled Apple keeps the lower-level access. Hopefully, we’ll see them open things up more in future releases.
People already turn to tools like Freedom https://freedom.to/ or custom iOS Shortcuts to enforce downtime, but those feel more like hacks than solutions. If Apple extended Assistive Access with scheduling or rules, it could really support intentional app use.
Google’s Digital Wellbeing https://wellbeing.google/ is proof there’s real demand for this. Apple could make Assistive Access a broader digital balance feature, not just an accessibility setting.
On the flip side, the rapid pace also shows there’s a lot of active development and bug fixing going on. Personally, I tend to wait until something gets packaged in Debian/Ubuntu too, because it means the maintainers have stabilized the dependency tree enough that distro maintainers trust it. Until then, I’ll usually sandbox it with Docker just to play around, but I wouldn’t put it in a “set it and forget it” deployment.
Curious though do you think a “long-term support” branch for projects like this would actually solve the problem, or would the underlying ecosystem still move too fast?
On the flip side, I had a friend who was underqualified for the same role. He put in so much effort and hustled harder than anyone else, but he always seemed to be just barely catching up. It’s like he was running a marathon while I was jogging, but we’d cross the line at the same time.
So yeah, I kind of get how the system “works” in its own weird way motivation and ability don’t always line up the way you’d expect.
What surprised me though was that it did run, albeit sluggishly, and I managed to get it summarizing Hacker News threads for me while offline. Felt like carrying a tiny AI research lab in my backpack — until I realized Chrome and Spotify together were basically a denial-of-service attack on my RAM.
Ever since then, I’ve been way more curious about how Apple’s ANE could help with this. If Core ML ever manages to push transformer workloads onto it smoothly, I might actually risk trying the 20B frontier again without my laptop sounding like a leaf blower.
What does worry me, though, is exactly what you pointed out about NPM’s response time. Given how central NPM packages are to the entire JavaScript ecosystem, you’d expect their security processes to be lightning fast. Every hour of delay can mean thousands (or millions) of downloads happening with potentially compromised code. And as you said, that just increases the incentive for attackers to target maintainers in the first place.
When Signal rolled out the cloud-based option, I realized it wasn’t just “selling cloud.” For people like me, who get busy, distracted, or just plain forgetful, having backups handled automatically (and still encrypted) feels more like insurance than a sales pitch.
So even though I technically could switch, the friction made it feel like Google had already won before I started. It’s not that alternatives don’t exist, it’s that they’re buried under a pile of defaults and contracts that make everyday users (like me) give up sooner or later.
As for AI tools, I’m in the same boat can’t access all of them where I live, but I’ve been impressed with the ones I can use. Perplexity has definitely been the standout for me too, both for quick factual lookups and for deeper dives when I don’t want to wade through endless search results. Having it synced across devices is such a game-changer; I’ll use it on my phone while commuting and then pick up the same threads on my laptop later. Honestly, I’d rather pay for something that saves me time every single day than stick with the old ways of searching.
You’re right that tools like memtest often miss the subtle problems, and even stress tests like Prime95 or y-cruncher don’t catch everything. That’s why having ECC as a built-in safeguard feels so valuable. With most modern AMD CPUs supporting ECC UDIMMs, the main variable really is whether the motherboard firmware enables it, which makes it important to double-check before buying. For me, the added stability and peace of mind have been well worth the small premium.
The onboarding angle is huge too: being able to “rent experience” in new frameworks drastically shortens ramp-up time, especially in environments with lots of stacks in play.
And you’re right about evaluation without real hours of use, it’s easy to underestimate what they can actually do. The “non-coders vibe coding” narrative misses that for experienced devs, they’re accelerants, not crutches.
One interesting side effect I’ve noticed when experimenting with LLM-driven heuristics is that, while they lack the determinism of static/runtime analysis, they can sometimes capture semantic relationships that are invisible to traditional tooling. For example, a change in a configuration file or documentation might not show up in a dependency graph, but an LLM can still reason that it’s likely to impact certain classes of tests. That fuzziness can introduce false positives, but it also opens the door to catching categories of risk that would normally be missed.
I think the broader question is how comfortable teams are with probabilistic guarantees in their workflows. For some, the precision/recall tradeoff is acceptable if it means faster feedback and reduced CI bills. For others, the lack of hard guarantees makes it a non-starter. But I do see a pattern emerging where LLM-based analysis isn’t necessarily a replacement for traditional methods, but a complementary layer that can generalize across stacks and fill in gaps where traditional tools don’t reach.