News for hackers. Stuff that matters.
Re:Anthropic’s $5B, 4-year plan to take on OpenAI by selectodude on Tuesday April 11, 2023 @08:02PM (#35533386)
The unified GPU/CPU memory structure on ARM Macs is very, very helpful for running these LLMs locally.
Re:Anthropic’s $5B, 4-year plan to take on OpenAI by EntrePrescott on Wednesday April 12, 2023 @12:53AM (#35535163)
Is there a big difference in principle between that and the "shared video memory" that has long existed on cheap x86 machines?

…or is it just that the latter had a way too weak iGPU and not enough RAM for AI purposes, whereas the bigger ARM MACs have more GPU power and enough RAM (more than most affordable discrete graphic cards) so that they are usable for some AI models?