News for hackers. Stuff that matters.
Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by magicalhippo on Thursday August 07, 2025 @02:04AM (#44821130)
Thanks, very nice explanation, that makes perfect sense. I guess their graphics confused me for some reason and had me thinking all wrong.

Now I see they tried to point out the obvious thing which is to predict multiple tokens ahead, not just two as in your example.

There are no comments on this comment yet.