News for hackers. Stuff that matters.

A comment on Ask HN: What hardware are you using to run local LLMs?.

Re:Ask HN: What hardware are you using to run local LLMs? by mannyv on Monday November 02, 2026 @03:05PM (#50342885)
I have a Mac Studio M1 Ultra with 128GB of RAM, an M5 Pro MBP with 64GB of RAM, and until recently an M1 Pro MBP with 32GB of RAM. I also have two Mac Minis with 16GB of RAM, but they're mainly used for embedding models because they're so small.

I'm doing a bunch of batch work for an experiment with them right now, but my daily driver is a Gemini Pro subscription.

[ Parent | on HN ]
Re:Ask HN: What hardware are you using to run local LLMs? by thway15269037 on Monday November 02, 2026 @04:08PM (#50343778)
How useful is 64GB M* Mac for running models? It is strictly below <64 Gigs or something bigger like Qwen-Flash-Next or GLM5.3-Flash is available at usable speeds too?

I kinda want a Mac machine to test and publish few apps, but I can't justify 128 or 256gb budget right now.

[ Parent | on HN ]