News for hackers. Stuff that matters.

banderwidthdk

From my experience LLM inference really, really likes memory bandwidth, which at 1.79 TB/s the 5090 has quite the lead on the APU's 273GB/s