News for hackers. Stuff that matters.
Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by CraigRood on Thursday August 07, 2025 @05:21AM (#44822338)
I was playing with it yesterday and every single session gave me factually incorrect information.

Speed and ease of use is one thing, but it shouldn't be at the cost of accuracy.

Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by OliverGuy on Thursday August 07, 2025 @06:33AM (#44822800)
If you are trying to get facts out of an LLM you are using it wrong, if you want a fact it should use a tool (eg we search, rag etc) to get the information that contains the fact (Wikipedia page, documentation etc) and then parse that document for the fact and return it to you.
Re:Running GPT-OSS-120B at 500 tokens per second on Nvidia GPUs by CraigRood on Sunday August 10, 2025 @02:09PM (#44857061)
These tools are literally being marketed as AI, yet it presents false information as fact. 'using it wrong' can't be an argument here. I would rather then tool is honest about confidence levels and mechanisms to research further - then feed that fact back into 'AI' for the next step.