Re:Ask HN: MacBook vs. Dedicated GPU for LLM
by gizajob on Saturday June 27, 2026 @12:40AM
(#48695193)
It’s completely shared so the OS and everything else takes up maybe 8GB of the RAM. On a 64GB machine you can run models about 45GB in size and still have space for those models run other tasks which themselves might need ram. To a user, the GPU appears to just use the RAM as much as it needs same as any other process running on the system. You can see what space your LLMs are taking up in Activity Monitor (or htop) and how much GPU capacity they’re using (all of it)
[ Parent
| on HN ]
There are no comments on this comment yet.