News for hackers. Stuff that matters.
Re:Anthropic’s $5B, 4-year plan to take on OpenAI by bugglebeetle on Tuesday April 11, 2023 @07:58PM (#35533351)
I’m pretty sure you can get a purpose-built pc tower in that range. Why would you favor a Mac over that? A lot of this stuff only has limited support for MacOS.
Re:Anthropic’s $5B, 4-year plan to take on OpenAI by selectodude on Tuesday April 11, 2023 @08:02PM (#35533386)
The unified GPU/CPU memory structure on ARM Macs is very, very helpful for running these LLMs locally.
Re:Anthropic’s $5B, 4-year plan to take on OpenAI by EntrePrescott on Wednesday April 12, 2023 @12:53AM (#35535163)
Is there a big difference in principle between that and the "shared video memory" that has long existed on cheap x86 machines?

…or is it just that the latter had a way too weak iGPU and not enough RAM for AI purposes, whereas the bigger ARM MACs have more GPU power and enough RAM (more than most affordable discrete graphic cards) so that they are usable for some AI models?

Re:Anthropic’s $5B, 4-year plan to take on OpenAI by evilduck on Tuesday April 11, 2023 @11:21PM (#35534646)
You can't get that much VRAM on a PC for a comparible price.