News for hackers. Stuff that matters.
Re:Intel's Immiseration – The Chip Letter by alecco on Sunday August 11, 2024 @09:31AM (#41216018)
Besides that it does matter (e.g. loading/saving LLMs), it speaks how Gaudi is not even using Intel's latest technology. They are clearly not in the main production pipeline. So Gaudi is not going to save Intel.
Re:Intel's Immiseration – The Chip Letter by ein0p on Sunday August 11, 2024 @02:23PM (#41218281)
But you don’t “load” models during inference. They are already on-device.