Re:Outperforming LLMs with less training data and smaller mo...
by leetharris on Thursday September 21, 2023 @11:41PM
(#37607576)
You can find many leaked email threads from Apple where they talk about the value of high powered local compute. It is a fundamental part of their strategy. They do not want the cloud approach for high end compute like Google, they want you to have high end and powerful devices in your hands.
Re:Outperforming LLMs with less training data and smaller mo...
by flangola7 on Friday September 22, 2023 @12:03AM
(#37607701)
Got a link to those emails?
Re:Outperforming LLMs with less training data and smaller mo...
by rubyn00bie on Thursday September 21, 2023 @11:21PM
(#37607441)
I disagree. ML is eating the world by storm and one thing Apple loves is high margins. Folks like myself would gladly pay that margin to someone besides Nvidia. I paid $2k for my last GPU and was happy to do it. That doesn’t even factor the fact that businesses would pay even more when the alternative are machines that start in the tens of thousands for just the GPU ability. GPUs right now are carrying fat margins and that makes more than enough incentive for Apple IMHO.
Re:Outperforming LLMs with less training data and smaller mo...
by behnamoh on Thursday September 21, 2023 @11:35PM
(#37607532)
But you wouldn't be able to upgrade an Apple Mac when the next generation of LLMs is out.
Re:Outperforming LLMs with less training data and smaller mo...
by nborwankar on Friday September 22, 2023 @10:26AM
(#37612509)
You do get some money back for a trade-in depending on how old the machine is.
- HW design
- UI
- UX
That Macs come with awesome VRAM is only because #3. Apple has no explicit incentive to make LLM-ready machines.