News for hackers. Stuff that matters.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by Aurornis on Monday August 31, 2026 @09:41AM (#49509701)
> it seems really far off from the kind of experience even a basic $20/month subscription gets me.

The $20/month subs are much stronger than the local models you can run, even with how far local models have advanced lately.

The appeal of local models is that the data never leaves your network so you can feel safer putting sensitive content into it. It also feels “free” to use when you’ve already paid for the hardware.

But it doesn’t perform better and if you do the math you’re probably not saving money either. It’s helpful for things that you can’t or don’t want to outsource to a 3rd party.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by seanmcdirmid on Monday August 31, 2026 @09:50AM (#49509807)
Uncensored models are also popular reasons, although it’s more of a niche.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by xnx on Monday August 31, 2026 @10:06AM (#49509997)
Aren't those also commonly available from cloud providers?
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by digitalsushi on Monday August 31, 2026 @10:15AM (#49510075)
i'd say 'with' instead of 'from', the cloud provider rents you the hardware, what you run on it, is whatever you show up with
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by BurningFrog on Monday August 31, 2026 @09:45AM (#49509742)
It also takes some load off the AI data centers.

IDK if that might be a concern for Apple or their AI partners.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by Scene_Cast2 on Monday August 31, 2026 @11:57AM (#49511282)
It worsens the supply crunch, no? A unit you use sparingly vs that memory going into a GPU that serves many more people.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by maherbeg on Monday August 31, 2026 @02:57PM (#49513504)
Those will use different wafers, so unless that memory is allocated for unified memory vs gpu HBM it won't make a difference.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by SMEbooop on Monday August 31, 2026 @04:06PM (#49514284)
What supply crunch? Tons of RAM available for purchase. It's just expensive. That there is a "supply crunch" is made up to benefit from Trump administration not giving a shit how big corps operate

There's cloud hosts out there with unused compute. Wasted cycles are all over businesses running unused cloud apps and subscribed to services they don't use.

Still need a local computer to access the cloud; so a barely used gadget still exists. And this creates duplication of effort; we built RAM for servers AND the edge devices.

Seems redundant when tech nerds and corporations are really the only people that care.

And all that data in the web is meaningless yet we create a supply crunch storing it in servers.

This an out of touch nickel and dime perspective given the big picture to say nothing of the mess of strip mining and manufacturing pipelines that go into every screw, wire, and such

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by articulatepang on Monday August 31, 2026 @11:03AM (#49510643)
Surely this is not something that motivates the vast majority of people using local LLMs.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by varispeed on Monday August 31, 2026 @02:05PM (#49512764)
I don't think it is really about "sensitive", but basically about any content you put in. Why would you give corporations your reasoning (data on how you interact with AI, how you "talk" etc.).

All of this is private, but not necessarily sensitive. You never know what is happening with this data. They might say they don't log it or don't sell it, then few years later you'll find it all online or read a book that has a story eerily similar to what you chatted about with GPT a year ago.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by fwip on Monday August 31, 2026 @04:03PM (#49514250)
Although in this use case, it's likely because GPT guided you to write the same story as somebody else. Talking with an LLM about an idea is a great way to make it more predictable and homogenized. If you're fixing a bike or writing software, this is usually a good thing.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by varispeed on Monday August 31, 2026 @05:52PM (#49515295)
Gemini not long ago, when you said something "useful" said thank you, I will use it to help other users with similar problem. When asked "why would you do that, I thought our chat is private?" it would respond "Apologies. My mistake, of course this chat is private and your information will not be used." Funny.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by pizza234 on Monday August 31, 2026 @02:42PM (#49513277)
There are a few use cases that are (somewhat) surprisingly unsuited for cloud providers:

- translations: cloud providers can bowdlerize (censor) bad words/content; also, if you want to do a translation for personal use of copyrighted materials, cloud providers may block it

- image generation: generating drawings with a style that even just resembles a copyrighted one (ie. Disney) may be blocked by cloud providers - for example, generating old cartoons style with GPT may not be possible.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by raffraffraff on Monday August 31, 2026 @04:14PM (#49514366)
What about a light but bulky AI job, like batch processing 50GB of files? I'm currently doing it on my used Macbook M1 Max 64gb, and it's chugging through it for the cost of electricity (free with my solar).
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by Gigachad on Monday August 31, 2026 @11:53PM (#49517773)
64gb unified memory is incredibly powerful for a local machine. Most of us have 16GB which is almost useless compared to the API models.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by raffraffraff on Thursday September 03, 2026 @01:09PM (#49553302)
Right now it's about €1650 for that machine (used, on ebay obviously)
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by nomel on Monday August 31, 2026 @03:40PM (#49514016)
Cloud does not mean censored. You can rent gpu time and run whatever model you want, with your data kept as private as any other cloud instance you personally run. Cloud is location, with (for some work) wayyyy cheaper access.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by ryandrake on Monday August 31, 2026 @03:52PM (#49514156)
Cloud is still not "your computer" so it's probably wise to take that into account and act in accordance with your own threat model.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by tiahura on Monday August 31, 2026 @03:02PM (#49513590)
Banks, Biglaw, and the Pentagon all do it in the cloud. What could an individual be working on that is so secretive?
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by Someone on Monday August 31, 2026 @03:11PM (#49513699)
> Banks, Biglaw, and the Pentagon all do it in the cloud.

In _a_ cloud: their own virtual private cloud. They also have enough power to negotiate contracts with strong privacy provisions.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by jmalicki on Monday August 31, 2026 @03:23PM (#49513819)
> They also have enough power to negotiate contracts with strong privacy provisions.

What privacy provisions would you want to add to AWS? Most of the reasonable strong privacy provisions you'd want are already there and/or available if you want to sign up for it, even including US Govt Top Secret data if you meet some approval.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by Larrikin on Monday August 31, 2026 @03:48PM (#49514120)
If they decide to ignore the contract and violate the privacy provisions, the US government can punish them, can the company from future contracts, throw executive in jail.

If they violate their privacy agreement with me there's effectively no punishment I can get that they will actually feel. There would have to be a class action law suit and they always just settle those for some small amount and admit to no wrong doing

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by wolvoleo on Monday August 31, 2026 @08:15PM (#49516419)
> If they decide to ignore the contract and violate the privacy provisions, the US government can punish them, can the company from future contracts, throw executive in jail.

To be honest, they'll just send a few million and some good plated trinkets to the right people and it'll go away. You know that's how things work now in the US. Even if you're an actual convicted drug dealer you can have your mother say a few nice things and whoop there's your get out of jail free card. This stuff is peanuts compared to that.

If not they'll just stall in court and settle for peanuts after everyone is exhausted battling it out. That's what they've always done before the current government.

Nobody's important is going to do any time for this. Not in this America.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by SR2Z on Monday August 31, 2026 @03:27PM (#49513882)
This kind of stuff is available off the shelf at any major cloud provider.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by NetMageSCW on Monday August 31, 2026 @05:14PM (#49514911)
Guaranteed privacy is available off the shelf?
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by SR2Z on Monday August 31, 2026 @06:53PM (#49515826)
Yes, insofar as any "guaranteed" is cloud providers just saying "we pinky swear to not decrypt your resources!"

I know what I'm talking about here - trust me when I say that the difference between a "government" or "large corpo" account and "some dude" is literally a few flags to prevent resources being created in the wrong regions. It's nothing that a random customer can't do themselves.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by bethekidyouwant on Tuesday September 01, 2026 @12:50PM (#49524550)
Why is the security in your home lab so much better than Amazons? Be specific.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by mbreese on Monday August 31, 2026 @03:07PM (#49513649)
Those companies also have data sharing/use agreements that they can get from Cloud AI providers due to their size and spend. The secrecy and data protection is largely what they are paying for. Those types of agreements just aren’t available to individual customers. It’s only when you’re spending $$$ that it becomes worth it for the provider.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by ozim on Monday August 31, 2026 @04:33PM (#49514547)
I like to buy specific brand of soap. I don't want them to know that, it is my right and so is running local LLM "wasting" money on local inference to keep track of my stack of soap.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by snikeris on Tuesday September 01, 2026 @11:43AM (#49523530)
The two issues I have with relying on the cloud for intelligence is:

- I don't trust them with my data

- I don't trust the data they send back to me

The first is about my privacy, the second is about not being manipulated by what is considered the politically correct answer to my questions.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by insane_dreamer on Monday August 31, 2026 @03:35PM (#49513966)
> much stronger than the local models you can run

but depending on what you're doing, you may not need the "bleeding edge" performance

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by segmondy on Monday August 31, 2026 @08:19PM (#49516445)
glm5.3 is matching fable in lots of places and beating it after more than 1 pass in many. now of course when i say this, folks would claim that it's not local, but it can be. if you happen to own a mac studio 512gb, you could run it.