News for hackers. Stuff that matters.
Re:Experimenting with Local LLMs on macOS by grim_io on Tuesday September 09, 2025 @10:13AM (#45182226)
Some would argue that the home theater is a superior experience to a crowded, far away movie theater where the person's head in front of you takes up a quarter of the screen.

The same can't be said for local inference. It is always interior in experience and quality.

A reasonable home theater pays for itself over time if you watch a lot of movies. Plus you get to watch shows as well, which the limited theater program doesn't allow.

I can buy over 8 years of the Claude max $100 plan for the price of the 512GB M3 Ultra. And I can't imagine the M3 being great at this after 5 years of hardware advancement.

Re:Experimenting with Local LLMs on macOS by rpdillon on Sunday September 14, 2025 @10:30AM (#45240003)
> The same can't be said for local inference. It is always interior in experience and quality.

Not really. I do it because it offers me more control. That's higher quality in my book.