News for hackers. Stuff that matters.

A comment on Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs. Parent comment

Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by torginus on Thursday August 07, 2025 @09:09AM (#44824027)
Inference takes quadratic amount of time wrt context size
[ Parent | on HN ]

There are no comments on this comment yet.