News for hackers. Stuff that matters.
Re:I Run LLMs Locally by 2-3-7-43-1807 on Sunday December 29, 2024 @05:13PM (#42543858)
how about heat dissipation which i assume a mbp is at a disadvantage compared to a pc?
Re:I Run LLMs Locally by Aurornis on Sunday December 29, 2024 @11:43PM (#42546547)
A MacBook Pro has lower peak thermal output but proportionally lower performance. For a given task you’d be dissipating somewhat similar heat, the MacBook Pro would just be spreading it out over a longer period of time.

nVidia GPUs actually have similar efficiency, despite all of Apple’s marketing. The difference is they the nVidia GPUs have a much higher ceiling.