News for hackers. Stuff that matters.
Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by exe34 on Thursday August 07, 2025 @04:42AM (#44822114)
I imagine the gguf is quantised stuff?
Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by DrPhish on Thursday August 07, 2025 @04:46AM (#44822147)
No, I’m running the unquantized 120b