News for hackers. Stuff that matters.
Re:Outperforming LLMs with less training data and smaller mo... by rubyn00bie on Thursday September 21, 2023 @10:49PM (#37607281)
Apple's hardware advantage is something I'm hoping to see really unleashed with the M3 generation. The fact the A17 Pro has ray tracing support is giving me hope they can catch up with the incumbents quickly. It's honestly the one thing that has kept me away from their newer hardware-- I primarily use my computer at a desk and PC hardware (GPU primarily) is leagues ahead of what their very best can do. I honestly can't justify spending nearly 4k when Linux works great for everything I do professionally AND when I'm done with work I can still play a game.
Re:Outperforming LLMs with less training data and smaller mo... by behnamoh on Thursday September 21, 2023 @11:09PM (#37607377)
3 most important things for Apple are:

- HW design

- UI

- UX

That Macs come with awesome VRAM is only because #3. Apple has no explicit incentive to make LLM-ready machines.

Re:Outperforming LLMs with less training data and smaller mo... by leetharris on Thursday September 21, 2023 @11:41PM (#37607576)
You can find many leaked email threads from Apple where they talk about the value of high powered local compute. It is a fundamental part of their strategy. They do not want the cloud approach for high end compute like Google, they want you to have high end and powerful devices in your hands.
Re:Outperforming LLMs with less training data and smaller mo... by flangola7 on Friday September 22, 2023 @12:03AM (#37607701)
Got a link to those emails?
Re:Outperforming LLMs with less training data and smaller mo... by rubyn00bie on Thursday September 21, 2023 @11:21PM (#37607441)
I disagree. ML is eating the world by storm and one thing Apple loves is high margins. Folks like myself would gladly pay that margin to someone besides Nvidia. I paid $2k for my last GPU and was happy to do it. That doesn’t even factor the fact that businesses would pay even more when the alternative are machines that start in the tens of thousands for just the GPU ability. GPUs right now are carrying fat margins and that makes more than enough incentive for Apple IMHO.
Re:Outperforming LLMs with less training data and smaller mo... by behnamoh on Thursday September 21, 2023 @11:35PM (#37607532)
But you wouldn't be able to upgrade an Apple Mac when the next generation of LLMs is out.
Re:Outperforming LLMs with less training data and smaller mo... by nborwankar on Friday September 22, 2023 @10:26AM (#37612509)
You do get some money back for a trade-in depending on how old the machine is.