News for hackers. Stuff that matters.
Re:Token growth indicates future AI spend per dev by bn-l on Monday August 11, 2025 @10:04PM (#44871545)
They don’t have the memory bandwidth
Re:Token growth indicates future AI spend per dev by hoppp on Tuesday August 12, 2025 @09:49AM (#44876164)
256 GB/s memory bandwidth is low but it still does around 40 tokens per sec with gpt-oss, good enough for local apps