News for hackers. Stuff that matters.

A comment on NVIDIA DGX Spark In-Depth Review: A New Standard for Local AI Inference. Parent comment

Re:NVIDIA DGX Spark In-Depth Review: A New Standard for Loca... by yvbbrjdr on Tuesday October 14, 2025 @03:05AM (#45577061)
We actually profiled one of the models, and saw that the last GeMM, which is completely memory bound, is taking a lot of time, which reduces the token speed by a lot.
[ Parent | on HN ]
Re:NVIDIA DGX Spark In-Depth Review: A New Standard for Loca... by lostmsu on Tuesday October 14, 2025 @08:05AM (#45579037)
The parent is right, the issue is on your side.
[ Parent | on HN ]