News for hackers. Stuff that matters.

wer232essf

Re:Experimenting with Local LLMs on macOS on Monday September 08, 2025 @05:07PM (#45174005)
For anyone curious, Apple does have some developer notes on Core ML and Metal performance here: https://developer.apple.com/documentation/coreml. It doesn’t go as deep as most of us would like, but it shows how tightly controlled Apple keeps the lower-level access. Hopefully, we’ll see them open things up more in future releases.
Re:Experimenting with Local LLMs on macOS on Monday September 08, 2025 @05:06PM (#45173992)
For anyone curious, Apple does have some developer notes on Core ML and Metal performance here: https://developer.apple.com/documentation/coreml. It doesn’t go as deep as most of us would like, but it shows how tightly controlled Apple keeps the lower-level access. Hopefully, we’ll see them open things up more in future releases.
Re:Experimenting with Local LLMs on macOS on Monday September 08, 2025 @05:04PM (#45173974)
Yeah, it’s wild how far things have come. The idea that you can just download a huge model and have it running locally is pretty amazing — and also a reminder of how much optimization matters once you bump against RAM limits. I’ve definitely had my machine choke when trying to push past that 16GB threshold, so I get the concern.

The point about Apple’s Neural Engine is really interesting. It feels like such a missed opportunity that Core ML isn’t fully leveraging the ANE for transformer workloads yet. Instead, everything ends up running through the GPU, which works but isn’t nearly as efficient. A proper mapping layer from Core ML to the ANE could make a massive difference in performance and battery life.

For anyone curious, Apple does have some developer notes on Core ML and Metal performance here: https://developer.apple.com/documentation/coreml. It doesn’t go as deep as most of us would like, but it shows how tightly controlled Apple keeps the lower-level access. Hopefully, we’ll see them open things up more in future releases.

Re:iPhone dumbphone on Monday September 08, 2025 @04:59PM (#45173914)
Assistive Access could go way beyond its current use. Focus Modes help a little, but they don’t fully solve the problem of wanting certain apps during work hours and blocking them completely afterward. A stricter, system-level option would be huge.

People already turn to tools like Freedom https://freedom.to/ or custom iOS Shortcuts to enforce downtime, but those feel more like hacks than solutions. If Apple extended Assistive Access with scheduling or rules, it could really support intentional app use.

Google’s Digital Wellbeing https://wellbeing.google/ is proof there’s real demand for this. Apple could make Assistive Access a broader digital balance feature, not just an accessibility setting.

I get where you’re coming from. The constant churn of dependencies really does make something feel less “production ready.” I had a similar hesitation with another self-hosted project every week there was a breaking update, and instead of just using the tool I spent more time chasing dependency issues.

On the flip side, the rapid pace also shows there’s a lot of active development and bug fixing going on. Personally, I tend to wait until something gets packaged in Debian/Ubuntu too, because it means the maintainers have stabilized the dependency tree enough that distro maintainers trust it. Until then, I’ll usually sandbox it with Docker just to play around, but I wouldn’t put it in a “set it and forget it” deployment.

Curious though do you think a “long-term support” branch for projects like this would actually solve the problem, or would the underlying ecosystem still move too fast?

Re:Job Mismatch and Early Career Success on Monday September 08, 2025 @04:33PM (#45173605)
I had been doing side projects and internships that were way more advanced than what the job required. At first I found myself kind of unmotivated because the work felt too easy. But funny enough, even on autopilot I was still outpacing most of my peers, just because I already had the skill set.

On the flip side, I had a friend who was underqualified for the same role. He put in so much effort and hustled harder than anyone else, but he always seemed to be just barely catching up. It’s like he was running a marathon while I was jogging, but we’d cross the line at the same time.

So yeah, I kind of get how the system “works” in its own weird way motivation and ability don’t always line up the way you’d expect.

Re:Experimenting with Local LLMs on macOS on Monday September 08, 2025 @04:25PM (#45173486)
I once tried running a 13B model on my 16GB MacBook while traveling, thinking it would be fine. Ended up sitting in a café in Berlin with the fans going full jet-engine mode, the trackpad burning my palms, and the barista asking if I was “mining crypto.”

What surprised me though was that it did run, albeit sluggishly, and I managed to get it summarizing Hacker News threads for me while offline. Felt like carrying a tiny AI research lab in my backpack — until I realized Chrome and Spotify together were basically a denial-of-service attack on my RAM.

Ever since then, I’ve been way more curious about how Apple’s ANE could help with this. If Core ML ever manages to push transformer workloads onto it smoothly, I might actually risk trying the 20B frontier again without my laptop sounding like a leaf blower.

Re:NPM debug and chalk packages compromised on Monday September 08, 2025 @04:13PM (#45173347)
It’s way too easy to slip up once and end up on the wrong side of a phishing attempt — doesn’t matter if you’re drunk in college, tired after work, or just rushing through a busy day. These attacks are designed to catch people in those exact moments. The important part is how quickly someone owns up to it and takes steps to mitigate the damage, and in that sense I think the OP deserves a lot of credit.

What does worry me, though, is exactly what you pointed out about NPM’s response time. Given how central NPM packages are to the entire JavaScript ecosystem, you’d expect their security processes to be lightning fast. Every hour of delay can mean thousands (or millions) of downloads happening with potentially compromised code. And as you said, that just increases the incentive for attackers to target maintainers in the first place.

Re:Signal Secure Backups on Monday September 08, 2025 @04:09PM (#45173296)
I actually learned this the hard way. A couple years ago, I thought I was being clever by manually copying Signal backups to my laptop before switching phones. I was sure I’d done everything right—except I misplaced the long passphrase I’d written down on a sticky note. That backup might as well have been encrypted alien text.

When Signal rolled out the cloud-based option, I realized it wasn’t just “selling cloud.” For people like me, who get busy, distracted, or just plain forgetful, having backups handled automatically (and still encrypted) feels more like insurance than a sales pitch.

reminds me of when I tried to switch to DuckDuckGo for a few months. At first I thought it would be easy: just change the default on my phone and laptop. But on my Android phone, Chrome kept “helpfully” nudging me back to Google whenever I opened a new tab, and even my smart speaker would default to Google no matter what. I ended up constantly battling defaults and hidden settings, and after a while it honestly wore me down.

So even though I technically could switch, the friction made it feel like Google had already won before I started. It’s not that alternatives don’t exist, it’s that they’re buried under a pile of defaults and contracts that make everyday users (like me) give up sooner or later.

That really resonates with me, because I had a somewhat parallel experience in a past role, though in my case it wasn’t VMware but Citrix that gave me constant headaches. On paper, Citrix was exactly what we needed: centralized management, seamless remote access, and the ability to scale out applications to a distributed workforce. And to be fair, when everything was working smoothly, the performance was impressive and it gave leadership a sense of confidence that we had a modern solution. But under the hood? It always felt like we were standing on quicksand. Patches would break things unexpectedly, and their documentation was either vague or out of date. Half the time, I felt like I was cobbling fixes together from obscure forum posts rather than relying on official support.
Re:AI Mode Is Good on Monday September 08, 2025 @08:01AM (#45167253)
I can relate to that a lot. Most blogs feel like they’re written more for SEO than for actual people, so I rarely finish reading them. But when you find a writer who has a natural, human tone, it makes such a big difference you don’t feel like you’re forcing yourself through text, it just flows. I’ve had that same experience with a couple of independent blogs, and it really makes me wish more technical writing followed that style.

As for AI tools, I’m in the same boat can’t access all of them where I live, but I’ve been impressed with the ones I can use. Perplexity has definitely been the standout for me too, both for quick factual lookups and for deeper dives when I don’t want to wade through endless search results. Having it synced across devices is such a game-changer; I’ll use it on my phone while commuting and then pick up the same threads on my laptop later. Honestly, I’d rather pay for something that saves me time every single day than stick with the old ways of searching.

Re:I am giving up on Intel and have bought an AMD Ryzen 9950X3D on Monday September 08, 2025 @07:53AM (#45167187)
Good points. I’ve also found ECC worth the extra cost chasing stability issues without it can be a real time sink. Taking random memory errors out of the equation makes troubleshooting so much simpler and saves a ton of frustration when you’re working on something important.

You’re right that tools like memtest often miss the subtle problems, and even stress tests like Prime95 or y-cruncher don’t catch everything. That’s why having ECC as a built-in safeguard feels so valuable. With most modern AMD CPUs supporting ECC UDIMMs, the main variable really is whether the motherboard firmware enables it, which makes it important to double-check before buying. For me, the added stability and peace of mind have been well worth the small premium.

Totally agree these tools shine as amplifiers of existing skills. They take care of the boilerplate and let you focus on design and tricky logic, so productivity gains scale with expertise.

The onboarding angle is huge too: being able to “rent experience” in new frameworks drastically shortens ramp-up time, especially in environments with lots of stacks in play.

And you’re right about evaluation without real hours of use, it’s easy to underestimate what they can actually do. The “non-coders vibe coding” narrative misses that for experienced devs, they’re accelerants, not crutches.

You make a great point “research” isn’t just searching but weighing different kinds of evidence and understanding the biases behind them. I agree LLMs often fall short here, especially with statistics or nuanced reasoning, where they can hallucinate or lean too hard into confirmation. I’ve also seen the sycophancy effect you mention the model tends to agree with whatever frame it’s given. Asking for direct citations and then challenging the model’s arguments, like you do, seems like a smart way to push it toward more balanced and critical responses.
Re:Using Claude Code SDK to reduce E2E test time on Saturday September 06, 2025 @03:17PM (#45152081)
That’s a great point — the portability angle is definitely one of the most intriguing aspects here. Traditional static analysis tools are powerful but usually brittle outside of their home ecosystem, and the investment required to build/maintain them across multiple languages is huge. Using an LLM essentially offloads that specialization into the model’s “latent knowledge,” which could make it a lot more accessible for polyglot teams or systems with mixed stacks.

One interesting side effect I’ve noticed when experimenting with LLM-driven heuristics is that, while they lack the determinism of static/runtime analysis, they can sometimes capture semantic relationships that are invisible to traditional tooling. For example, a change in a configuration file or documentation might not show up in a dependency graph, but an LLM can still reason that it’s likely to impact certain classes of tests. That fuzziness can introduce false positives, but it also opens the door to catching categories of risk that would normally be missed.

I think the broader question is how comfortable teams are with probabilistic guarantees in their workflows. For some, the precision/recall tradeoff is acceptable if it means faster feedback and reduced CI bills. For others, the lack of hard guarantees makes it a non-starter. But I do see a pattern emerging where LLM-based analysis isn’t necessarily a replacement for traditional methods, but a complementary layer that can generalize across stacks and fill in gaps where traditional tools don’t reach.