Why your boss isn't worried about AI – "can't you just turn it off?"

Re:Why your boss isn't worried about AI – "can't you just tu... by Gigachad on Tuesday October 14, 2025 @08:22PM (#45586605)

I do prefer that Apple is opting to have everything run on device so you aren’t being exposed to privacy risks or subscriptions. Even if it means their models won’t be as good as ones running on $30,000 GPUs.

[ Parent | on HN ]

Re:Why your boss isn't worried about AI – "can't you just tu... by gerdesj on Tuesday October 14, 2025 @09:57PM (#45587238)

On device.

If you have say 16GB of GPU RAM and around 64GB of RAM and a reasonable CPU then you can make decent use of LLMs. I'm not a Apple jockey but I think you normally have something like that available and so you will have a good time, provided you curb your expectations.

I'm not an expert but it seems that the jump from 16 to 32GB of GPU RAM is large in terms of what you can run and the sheer cost of the GPU!

If you have 32GB of local GPU RAM and gobs of RAM you can rub some pretty large models locally or lots of small ones for differing tasks.

I'm not too sure about your privacy/risk model but owning a modern phone is a really bad starter for 10! You have to decide what that means for you and that's your thing and your's alone.

[ Parent | on HN ]

Re:Why your boss isn't worried about AI – "can't you just tu... by alfalfasprout on Tuesday October 14, 2025 @08:26PM (#45586636)

It also means that when the VC money runs dry, it's sustainable to run those models on-device vs. losing money running on those $$$$$ GPUs (or requiring consumers to opt for expensive subscriptions).

[ Parent | on HN ]

Re:Why your boss isn't worried about AI – "can't you just tu... by DrewADesign on Tuesday October 14, 2025 @10:48PM (#45587583)

I’m kind of surprised to see people gloss over this aspect of it when so many folks here are in the “if I buy it, I should own it” camp.

[ Parent | on HN ]