News for hackers. Stuff that matters.
Re:Laptop Isn't Ready for LLMs. That's About to Change by azuanrb on Tuesday December 23, 2025 @04:05PM (#46369447)
You still need ridiculously high spec hardware, and at Apple’s prices, that isn’t cheap. Even if you can afford it (most won't), the local models you can run are still limited and they still underperform. It’s much cheaper to pay for a cloud solution and get significantly better result. In my opinion, the article is right. We need a better way to run LLMs locally.
Re:Laptop Isn't Ready for LLMs. That's About to Change by almosthere on Tuesday December 23, 2025 @04:20PM (#46369607)
749 for an M4 air at Amazon right now
Re:Laptop Isn't Ready for LLMs. That's About to Change by tossandthrow on Tuesday December 23, 2025 @04:37PM (#46369751)
Try running anything interesting on these 8gb of ram.

You need 96gb or 128gb to do non trivial things. That is not yet 749 usd

Re:Laptop Isn't Ready for LLMs. That's About to Change by badc0ffee on Tuesday December 23, 2025 @04:46PM (#46369848)
Fair enough, but they start at 16GB nowadays.
Re:Laptop Isn't Ready for LLMs. That's About to Change by kylec on Tuesday December 23, 2025 @06:22PM (#46370682)
The M4 starts with 16GB, though that can also be tight for local LLMs. You can get one with 24GB for $1149 right now though, which is good value.
Re:Laptop Isn't Ready for LLMs. That's About to Change by almosthere on Wednesday December 24, 2025 @12:46PM (#46377580)
899 at B&H started today 12/24
Re:Laptop Isn't Ready for LLMs. That's About to Change by jki275 on Tuesday December 23, 2025 @05:33PM (#46370266)
64gb is fine.
Re:Laptop Isn't Ready for LLMs. That's About to Change by kibwen on Tuesday December 23, 2025 @06:14PM (#46370614)
This subthread is about the Macbook Air, which tops out at 32 GB, and can't be upgraded further.

While browsing the Apple website, it looks like the cheapest Macbook with 64 GB of RAM is the Macbook Pro M4 Max with 40-core GPU, which starts at $3,899, a.k.a. more than five times more expensive than the price quoted above.

Re:Laptop Isn't Ready for LLMs. That's About to Change by jki275 on Sunday December 28, 2025 @11:13AM (#46412080)
I have an M1 Max w/ 64gb that cost me much less than that -- you don't have to buy the latest model brand new.
Re:Laptop Isn't Ready for LLMs. That's About to Change by seanmcdirmid on Tuesday December 23, 2025 @06:58PM (#46370932)
if you are going for 64GB, you need at least a Max CPU or you will be bandwidth/GPU limited.
Re:Laptop Isn't Ready for LLMs. That's About to Change by onion2k on Tuesday December 23, 2025 @04:54PM (#46369919)
You still need ridiculously high spec hardware, and at Apple’s prices, that isn’t cheap.

You can easily run models like Mistral and Stable Diffusion in Ollama and Draw Things, and you can run newer models like Devstral (the MLX version) and Z Image Turbo with a little effort using LM Studio and Comfyui. It isn't as fast as using a good nVidia GPU or a cloud GPU but it's certainly good enough to play around with and learn more about it. I've written a bunch of apps that give me a browser UI talking to an API that's provided by an app running a model locally and it works perfectly well. I did that on an 8GB M1 for 18 months and then upgraded to a 24GB M4 Pro recently. I still have the M1 on my network for doing AI things in the background.

Re:Laptop Isn't Ready for LLMs. That's About to Change by liuliu on Tuesday December 23, 2025 @08:01PM (#46371297)
You can run newer models like Z Image Turbo or FLUX.2 [dev] using Draw Things with no effort too.
Re:Laptop Isn't Ready for LLMs. That's About to Change by jki275 on Tuesday December 23, 2025 @05:32PM (#46370264)
I bought my M1 Max w/ 64gb of ram used. It's not that expensive.

Yes, the models it can run do not perform like chatgpt or claude 4.5, but they're still very useful.

Re:Laptop Isn't Ready for LLMs. That's About to Change by mirror_neuron on Wednesday December 24, 2025 @01:52PM (#46378135)
I’m curious to hear more about how you get useful performance out of your local setup. How would you characterize the difference in “intelligence” of local models on your hardware vs. something like chatgpt? I imagine speed is also a factor. Curious to hear about your experiences in as much detail as you’re willing to share!
Re:Laptop Isn't Ready for LLMs. That's About to Change by jki275 on Monday December 29, 2025 @04:52PM (#46426197)
Local models won't generally have as much context window, and the quantization process does make them "dumber" for lack of a better word.

If you try to get them to compose text, you'll end up seeing a lot less variety than you would with a chatgpt for instance. That said, ask them to analyze a csv file that you don't want to give to chatgpt, or ask them to write code and they're generally competent at it. the high end codex-gpt-5.2 type models are smarter, may find better solutions, may track down bugs more quickly -- but the local models are getting better all the time.

Re:Laptop Isn't Ready for LLMs. That's About to Change by whitehexagon on Tuesday December 23, 2025 @06:10PM (#46370582)
I was pleasantly surprised at the speed and power of my second hand M1 Pro 32GB running Asahi & Qwen3:32B. It does all I need, and I dont mind the reading pace output, although I'd be tempted by M2 Ultra if the secondhand market hadn't also exploded with the recent RAM market manipulations.

Anyway, I'm on a mission to have no subscriptions in the New Year. Plus it feels wrong to be contributing towards my own irrelevance (GAI).