News for hackers. Stuff that matters.

A comment on Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs. Parent comment

Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by jlebar on Thursday August 07, 2025 @03:06AM (#44821460)
Just want to suggest: Ask an LLM about it! If you have access to a reasoning model like o3, I've found it to be very helpful.

I think this answer is as good as any of the human-generated ones in the thread so far, but the real power is that you can ask it follow-up questions. https://chatgpt.com/share/6894504f-4458-8008-a8c9-f371588259...

[ Parent | on HN ]
Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by magicalhippo on Thursday August 07, 2025 @03:17PM (#44829105)
I often do. But if I ask here then often it can generate some positive discussion, which is nice.
[ Parent | on HN ]