News for hackers. Stuff that matters.
Re:The Asus Ascent GX10 a Nvidia GB10 Mini PC with 128GB of ... by RamboRogers on Thursday March 20, 2025 @02:07PM (#43426759)
Memory speed is way slower than mac studio, be interested to see benchmarks.
Re:The Asus Ascent GX10 a Nvidia GB10 Mini PC with 128GB of ... by bitsandboots on Thursday March 20, 2025 @04:52PM (#43428820)
Benchmarks of what? Memory speed matters for some things but not others. It matters a lot for AI training, but less for AI inference. It matters a lot for games too, but nobody would play a game on this or a mac.
Re:The Asus Ascent GX10 a Nvidia GB10 Mini PC with 128GB of ... by buildbot on Thursday March 20, 2025 @05:33PM (#43429246)
AI inference is actually typically bandwidth limited compared to training, which can re-use the weights for all tokens <sequence length> * <batch size>. Inference, specifically decoding, requires you to read all of the weights for each new token, so the flops per byte are much lower during inference!