News for hackers. Stuff that matters.

A comment on LLMs Are Complicated Now. Parent comment

Re:LLMs Are Complicated Now by alfiedotwtf on Sunday June 21, 2026 @08:36AM (#48618397)
I don’t k ow what I’m doing wrong. Everyone says ds4 is faster than a lot of models around the same size, but I’m getting 2t/s with DSv4 vs 12t/s with Minimax 2.7 (16Gb 5080 + 16gb 5060ti + 128gb ram).
[ Parent | on HN ]
Re:LLMs Are Complicated Now by enduser on Monday June 22, 2026 @01:28AM (#48626057)
ds4 is optimized for systems with unified memory. it works best on apple silicon with 96GB+ of RAM
[ Parent | on HN ]
Re:LLMs Are Complicated Now by alfiedotwtf on Monday June 22, 2026 @03:34AM (#48626964)
ah! ok, now that makes sense. Thanks for that.
[ Parent | on HN ]