Re:Nvidia DGX Spark: great hardware, early days for the ecos...
by behnamoh on Wednesday October 15, 2025 @02:46AM
(#45588875)
the question is: how does the prompt processing time on this compare to M3 Ultra because that one sucks at RAG even though it can technically handle huge models and long contexts...
[ Parent
| on HN ]
Re:Nvidia DGX Spark: great hardware, early days for the ecos...
by zozbot234 on Wednesday October 15, 2025 @04:43AM
(#45589686)
Prompt processing time on Apple Silicon might benefit from making use of the NPU/Apple Neural Engine. (Note, the NPU is bad if you're limited by memory bandwidth, but prompt processing is compute limited.) Just needs someone to do the work.