News for hackers. Stuff that matters.

A comment on My $600 Mac Mini Runs a 35B AI Model. Parent comment

Re:My $600 Mac Mini Runs a 35B AI Model by bigyabai on Monday April 13, 2026 @06:15PM (#47758631)
llama-cpp's process is, but macOS itself will swap hard when 10-14gb of memory is paged for LLM inference. Dense models especially would thrash zram.
[ Parent | on HN ]

There are no comments on this comment yet.