Re:Show HN: Run 500B+ Parameter LLMs Locally on a Mac Mini
by bbtc3453 on Tuesday March 10, 2026 @07:49AM
(#47321961)
This is impressive. I've been experimenting with Gemini API for a side project and the latency difference between local and cloud inference is something I keep thinking about. How does memory usage scale with the 500B models?
[ Parent
| on HN ]
There are no comments on this comment yet.