News for hackers. Stuff that matters.
Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @10:26AM (#47587875)
Users don’t care about “privacy”. If they did, Meta and Alphabet wouldn’t be worth $1T+.

Users really don’t matter at all. The revenue for AI companies will be B2B where the user is not the customer - including coding agents. Most people don’t even use computers as their primary “computing device” and most people are buying crappy low end Android phones - no I’m not saying all Android phones are crappy. But that’s what most people are buying with the average selling price of an Android phone being $300.

Re:Ollama is now powered by MLX on Apple Silicon in preview by barelysapient on Tuesday March 31, 2026 @10:48AM (#47588162)
Different users. Many people care about privacy and aren’t using Meta products. And many businesses care about it too and have information policies to protect their IP.
Re:Ollama is now powered by MLX on Apple Silicon in preview by amelius on Tuesday March 31, 2026 @11:46AM (#47589140)
> Different users. Many people care about privacy and aren’t using Meta products.

Yeah but if they can rake in 100x as much by making products for people who don't care about privacy, then why spend time developing stuff for people who care?

There is still a small market left, of course, but that market will not have the billions of R&D behind it.

Re:Ollama is now powered by MLX on Apple Silicon in preview by woopsn on Tuesday March 31, 2026 @12:45PM (#47590083)
It's largely out of Meta's hands now anyway. The risk here not so much to privacy (it's Apple) but they'll walled garden the model space somehow for sure.
Re:Ollama is now powered by MLX on Apple Silicon in preview by bigyabai on Tuesday March 31, 2026 @01:31PM (#47590776)
> but they'll walled garden the model space somehow for sure.

People have said this since Pytorch was published and it's not any more true now than it was 10 years ago.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @10:58AM (#47588299)
70% of the world’s population use at least one Meta property at least once per day. How many of the other 30% are too poor/young/computer illiterate to be part of an addressable market?

Every company has dozens of SaaS products that store their business critical information. Amazon installs Office on each computer, Slack (they were moving away from Chime when I left), and the sales department uses SalesForce - SA’s and Professional Services (former employee).

The addressable market of even companies that care about privacy is not a large addressable market. How long will it be before computers become cheap enough that can run even GPT 4 level LLMs that companies will give it to all of their developers?

Re:Ollama is now powered by MLX on Apple Silicon in preview by JambalayaJimbo on Tuesday March 31, 2026 @11:34AM (#47588904)
The banking industry absolutely does care about privacy of their business data btw. We do use tools like Confluence but they're all hosted in our own data centers.
Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @11:37AM (#47588969)
And Capital One and Goldman Sachs are both hosted on AWS…
Re:Ollama is now powered by MLX on Apple Silicon in preview by Aissen on Wednesday April 01, 2026 @04:28AM (#47598324)
Re:Ollama is now powered by MLX on Apple Silicon in preview by innagadadavida on Tuesday March 31, 2026 @11:31AM (#47588853)
These are all great statistics, but how do you explain ClawdBot explosion. Even in lower income countries like China. So much demand that Apple can’t keep up production of Mac Minis. Why aren’t these folks going towards cloud solutions? Is it cost or is there some consideration for having more control over their data?
Re:Ollama is now powered by MLX on Apple Silicon in preview by zozbot234 on Tuesday March 31, 2026 @11:34AM (#47588919)
ClawBot doesn't generally run the model locally, it just talks to remote APIs. No different than any other agentic harness. You could run a local model on the same Mac Mini as your agent, but it wouldn't be very smart and many agentic tasks around computer GUI/browser use, etc. would be out of reach.
Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @11:36AM (#47588950)
And people using Clawdbot are still not using local inference for the most part…

They aren’t buying high end $2000+ Mac Minis.

Re:Ollama is now powered by MLX on Apple Silicon in preview by bigyabai on Tuesday March 31, 2026 @01:33PM (#47590797)
> Why aren’t these folks going towards cloud solutions?

They are. The majority aren't doing inference on a Mac Mini, but instead using it as a local host for cloud-based inference. You could have the same general experience on a $200 Chromebook or $300 Windows box.

Re:Ollama is now powered by MLX on Apple Silicon in preview by JSR_FDED on Wednesday April 01, 2026 @10:39AM (#47601595)
Not if you want to use Messages to talk to it.
Re:Ollama is now powered by MLX on Apple Silicon in preview by bigyabai on Wednesday April 01, 2026 @01:49PM (#47604151)
If you refuse to abandon iMessage for $300 in MSRP savings, you are beyond helping.
Re:Ollama is now powered by MLX on Apple Silicon in preview by victorbjorklund on Tuesday March 31, 2026 @02:23PM (#47591465)
They are running cloud models in almost all cases. Like saying it isn’t cloud when you use the Facebook app on your phone (it is ON your phone and running there).
Re:Ollama is now powered by MLX on Apple Silicon in preview by abu_ameena on Tuesday March 31, 2026 @11:01AM (#47588343)
I see it as a long-term tradeoff on user freedom. You pay upfront for a capable hardware, you get your services running locally (you don’t pay subscriptions). Or you buy cheap hardware, you still need the same services “running in some cloud” for $X monthly. X goes up depending on the corporate bottom-line
Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @11:07AM (#47588471)
In the history of cloud computing, prices have mostly only come down especially as inference becomes a commodity. Realistically, just looking at Mac prices, the cost of a computer with decent local inference would be around $6000 per person.

The world is not moving back to on prem.

Re:Ollama is now powered by MLX on Apple Silicon in preview by esseph on Tuesday March 31, 2026 @11:17AM (#47588610)
> The world is not moving back to on prem.

Lol, you should tell my customers (that are moving back on prem) that!

You should also tell Microsoft, who just yesterday said they are going back to focusing on local apps.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @11:39AM (#47588998)
Your customers are an anecdote, now compare that to the publicly reported numbers from AWS, GCP and Azure where they all say the only thing keeping them from growing more is the chip shortage.
Re:Ollama is now powered by MLX on Apple Silicon in preview by esseph on Tuesday March 31, 2026 @11:41AM (#47589045)
Oh I'm sure they'll continue to have some cloud services, no doubt. But look at VMware for example, even after the insane price increases. Nutanix also seems to be doing quite well. I'm seeing a fair amount of on-prem bare metal k8s too.
Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @12:01PM (#47589392)
Again - anecdotes is not data. We have data. That would be about as silly as me citing my own experience as proof that “everyone is moving to AWS” when I work for a company that is exclusively an AWS partner consulting company.
Re:Ollama is now powered by MLX on Apple Silicon in preview by esseph on Tuesday March 31, 2026 @05:34PM (#47593756)
> Again - anecdotes is not data. We have data.

You have data showing growth in cloud, which I expect and don't disagree with. The data I come across shows this too!

What I disagree with, from my own experiences and all the data I can seem to find online is that the growth rate in repatriation is MUCH higher than the growth in cloud.

It has flipped over the last 3yr.

US Enterprises, Fortune 100, especially. Also a lot of public entities (gov).

"In 2025, repatriation is still generally an upward trend. Data from the end of 2024 showed that 86% of CIOs planned to move some public cloud workloads back to private cloud or on-premises — the highest on record for the Barclays CIO Survey."

"Real examples of cloud repatriation include Dropbox, Adobe, and GEICO. All three companies moved a significant portion of their infrastructure onto public cloud before moving it to a combination of on-premises and hybrid cloud providers."

Noted: SaaS accounts for 46.10% of market revenue, while PaaS is the fastest-growing segment at 21.35% CAGR

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @06:18PM (#47594229)
Again, anecdotes. I have public company quarterly statements - you have unsourced quotes. You can quote Geico - I can quote Netflix. If on prem was really growing, I wouldn’t expect Intel to be in the shitter and I would expect Capex to be focused on Colo centers not cloud.

Also when I searched for your quotation the very next paragraph was

“ This trend does not represent a rejection of cloud computing. Organizations continue investing heavily in cloud services, with Gartner forecasting that global cloud spending will reach approximately $723 billion by the end of 2025.”

Re:Ollama is now powered by MLX on Apple Silicon in preview by esseph on Tuesday March 31, 2026 @10:19PM (#47595998)
That doesn't dispute what I said, in fact it agrees with what I said. Read it again.

> You have data showing growth in cloud, which I expect and don't disagree with. The data I come across shows this too!

Re:Ollama is now powered by MLX on Apple Silicon in preview by Aurornis on Tuesday March 31, 2026 @01:19PM (#47590592)
> Realistically, just looking at Mac prices, the cost of a computer with decent local inference would be around $6000 per person.

As someone who has hardware in that price range and plays with local LLMs: The gap between Opus or GPT and the local models is still very large for work beyond simple queries.

Self-hosted also starts making my office hot due to all of the power consumption when I use it for anything more than short queries. If you haven't heard your Mac's fans spin up much yet, running local LLMs will get you acquainted with the sound of their cooling systems at full blast.

Re:Ollama is now powered by MLX on Apple Silicon in preview by DesiLurker on Tuesday March 31, 2026 @11:29AM (#47588816)
you are missing a but 'given a choice' disclaimer. Meta is pretty much a monopoly in social space. So is Android. given a choice people will absolutely gravitate towards not-always-snooping device. most people with resources anyway, who matter for the AI adoption.

Oh an wait till ad companies start selling your healthcare data and you will see how fast things turn 'given a choice'.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @11:30AM (#47588835)
People A) don’t have to use Meta and B) do have a choice between not using a mobile phone by an ad tech company.
Re:Ollama is now powered by MLX on Apple Silicon in preview by nozzlegear on Tuesday March 31, 2026 @01:46PM (#47590994)
People don't have a choice between Facebook and not-Facebook-but-still-has-all-of-your-friends-and-family. Abstinence isn't a choice here any more than shutting off your cell phone service is a choice; true in the literal sense, but only if you don't mind being unreachable to everyone who still has a phone.
Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @02:47PM (#47591746)
And they do have a choice on proactively giving FB more information than just what it infers
Re:Ollama is now powered by MLX on Apple Silicon in preview by roadside_picnic on Tuesday March 31, 2026 @12:56PM (#47590247)
> Users don’t care about “privacy”.

I worked for a research focused AI startup that had a strict "no external LLM" policy for code touching our core research.

You're right that the average consumer doesn't care about privacy, but there are many, many users who do. The average consumer also don't have a desktop with GPU or high end Mac Studio, but that doesn't mean there aren't many people working with AI how do have these things.

If we continue to see improvements in running local models, and RAM prices continue to fall as they have in the last month, then suddenly you don't have to worry about token counts any more and can be much more trusting of your agents since they are fully under your control.

Re:Ollama is now powered by MLX on Apple Silicon in preview by charcircuit on Tuesday March 31, 2026 @01:51PM (#47591059)
Those users are addressed by being able to rent their own exclusive machines to run the model on. There will be some compromise that will be made to get access to the best intelligence available.
Re:Ollama is now powered by MLX on Apple Silicon in preview by KerrAvon on Tuesday March 31, 2026 @02:47PM (#47591736)
As one of those users: absolutely fucking not.
Re:Ollama is now powered by MLX on Apple Silicon in preview by xprnio on Wednesday April 01, 2026 @07:03AM (#47599261)
You will own nothing, and you will be greatful for it
Re:Ollama is now powered by MLX on Apple Silicon in preview by Angostura on Tuesday March 31, 2026 @01:33PM (#47590807)
It’s not all or nothing there ads trade offs. The fact that Apple still bothers to expend marketing effort on its privacy chops suggests significant numbers of people still do care.
Re:Ollama is now powered by MLX on Apple Silicon in preview by ilovecake1984 on Tuesday March 31, 2026 @01:37PM (#47590863)
Users here probably means corporations. I still don’t see much use of LLMs in my personal life, other than one thing. Googling stuff in a foreign language.
Re:Ollama is now powered by MLX on Apple Silicon in preview by api on Tuesday March 31, 2026 @01:42PM (#47590929)
"Users" is a large set of people. Many don't care about privacy, but some do. There's also a difference between where you post random social media stuff vs what you run with something like OpenClaw and give access to your machine.
Re:Ollama is now powered by MLX on Apple Silicon in preview by Nevermark on Tuesday March 31, 2026 @01:53PM (#47591083)
Have you done A/B tests to see if consumers prefer Facebook with or without privacy?

No? What? Oh, you can't?

Neither can consumers. Most consumers are very aware of the lack of privacy, the manipulation, and have very cynical feelings about Facebook and similar companies. But it's where their friends and family are.

For most people the web is a mine field maze where basic things they want are compromised everywhere. And they are routinely creeped out by ads that reveal they know them far too personally.

You are mistaking network capture for preference.

Another telling example. Lots of privacy valuing technical people, who would never have a Facebook account, send unencrypted text emails.

It is network capture, not preference.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @02:43PM (#47591688)
Consumers pro actively tell Facebook their age, sexual preference, race, relationship status, likes and dislikes, they check in to where they are and who they are there with…

They are choosing to give Facebook info.

Re:Ollama is now powered by MLX on Apple Silicon in preview by Nevermark on Tuesday March 31, 2026 @03:07PM (#47592002)
> They are choosing to give Facebook info.

Yes, they do. That's is exactly the phenomena my comment addressed.

But the way you wrote that implies an improbable motivation or choice framing.

Perhaps their real motive/choice is to share with other people on the site.

It is called a network effect.

If (1) Facebook had been the surveillance/manipulation capital of the world from inception, (2) an equally inviting privacy protecting site took off at the same time, and (3) everyone chose Facebook over E2EE anyway, then sure, we could throw up our hands! Those silly users!

The term I have for when people discuss choices involving many-dimensional criteria, as if the choice involved just one or two selected dimensions, is "dimension blindness". It happens in a lot of heated discussions about phone choices too.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @03:35PM (#47592348)
Wouldn’t the most obvious way for people to protect their privacy while using FB if they cared and still wanted to use FB be not to proactively give them information? You don’t have to share everything I mentioned just to be involved in a group.
Re:Ollama is now powered by MLX on Apple Silicon in preview by Nevermark on Tuesday March 31, 2026 @03:50PM (#47592521)
> You don’t have to share everything I mentioned just to be involved in a group.

This is clearly true. There is an implied point here but I am not sure what.

They share in their profile what they want other people to see. And often choose to not fill out everything. Nobody signs up to share with Meta, Inc.

People choosing an imperfect option, from imperfect options, are not demonstrating evidence they don't care about the imperfections.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @04:09PM (#47592784)
They are explicitly adding their information to FB why do they need a button to not share the information? Would the button disable them from checking in and updating their profile?
Re:Ollama is now powered by MLX on Apple Silicon in preview by Nevermark on Tuesday March 31, 2026 @04:26PM (#47593002)
An E2EE system (e.g. as offered by Apple iCloud). Or a terms of service guarantee. (e.g. Dropbox, Anthropic and 1000 other companies that partition sharable user content from non-support divisions.)

> Would the button disable them from checking in and updating their profile?

No.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @07:40PM (#47594921)
When you post a check in, your relationship status, your pictures without setting your sharing preferences and update your profile - you are specifically doing with the intention to share. WhatsApp is E2E encrypted
Re:Ollama is now powered by MLX on Apple Silicon in preview by Nevermark on Tuesday March 31, 2026 @10:46PM (#47596169)
I already gave you a storage/share E2EE example.

I suggest that when things keep going over your head, like they did here, just Google the topic.

And when people are kind enough to reply to your confusion, read with a little more care.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Tuesday March 31, 2026 @11:27PM (#47596455)
I am not confused at all.

You’re arguing that people care about their privacy when they are explicitly sharing private information above what is needed to participate in FB.

You are completely wrong and your argument is illogical. People may not know that FB is making a profile of you based on your behavior. But logically, if I add to my profile that my favorite site is “grandma-midget-porn.com” [1], that I care that people don’t know I like senior citizen midgets

[1] Please don’t let that be a real website.

Re:Ollama is now powered by MLX on Apple Silicon in preview by Nevermark on Tuesday March 31, 2026 @11:56PM (#47596621)
Please reread what i wrote from the start more carefully.

I am not claiming what percentage of people care or not. I made a valid point of what is evidence or not, for not caring.

You also responded to my E2EE reference without absorbing the example.

It isn’t a big deal. We can move on.

Re:Ollama is now powered by MLX on Apple Silicon in preview by raw_anon_1111 on Wednesday April 01, 2026 @02:15AM (#47597453)
Because it is irrelevant to whether people are purposefully explicitly sharing their likes and dislikes, and other information to let FB know more about them.
Re:Ollama is now powered by MLX on Apple Silicon in preview by Nevermark on Thursday April 02, 2026 @07:28AM (#47612973)
Of course. Nobody disputes whether.
Re:Ollama is now powered by MLX on Apple Silicon in preview by barkerja on Tuesday March 31, 2026 @01:57PM (#47591137)
User's care about privacy when they understand the threat and impact. The issue is most user's don't understand this, especially when it comes to use of products like Meta where on the surface, everything appears harmless.
Re:Ollama is now powered by MLX on Apple Silicon in preview by duxup on Tuesday March 31, 2026 @04:46PM (#47593273)
Yeah I agree, I fear users don’t care “enough” about privacy that it will matter. :(

Care at all sure, but enough to make a difference, the history of the web and recent computing history indicates otherwise.