News for hackers. Stuff that matters.
Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by Foobar8568 on Monday August 31, 2026 @02:54PM (#49513469)
Memory used : 38GB, and I haven't even started a LLM nor podman, I always fight with memory when using LLM on my mac with 48gb.

And I don't remember to have been able to have pushed to 200k context Qwen 3.6. 3.8 is running on my RTX 5090.

Re:Apple Caught Off Guard by AI Demand for Mac Mini and Mac ... by redox99 on Monday August 31, 2026 @03:59PM (#49514220)
Qwen 27B runs very comfortably on a 5090. You need to use Q4 quants and Q8 KV cache. Here's the math

https://news.ycombinator.com/item?id=49514141