News for hackers. Stuff that matters.
Re:GPT‑5 was the push I needed to switch to open‑source by WorldPeas on Tuesday August 12, 2025 @07:07PM (#44882814)
I see you're crossposting your reddit post, so I'll reply here. In my benchmarks oss-120 is not very smart. Its tool use is quite lacking and as you might guess, has no access to the larger internet out of the box or posttraining. For your needs the sentiment is right however, though you'd probably be better off with Qwen or Kimi K2, if you can run it
Re:GPT‑5 was the push I needed to switch to open‑source by jandll on Tuesday August 12, 2025 @07:38PM (#44883036)
Yeah I run got oss 20b. I have DeepSeek-r1:14b-qwen, but it doesn’t work well with what I need it for. But I probably haven’t set it up optimally. Any advice how to get the most out of it?
Re:GPT‑5 was the push I needed to switch to open‑source by WorldPeas on Tuesday August 12, 2025 @07:59PM (#44883197)
you'll probably get more bang for buck with MOE or fp4 models, but other than that I've got little advice save for using some good search MCP tools like perplexity, or brave search to add factuality to the model (you'll need to alter the system prompt so the model is more inclined to make tool calls)