Re:GPT‑6.2 Astra and Sol
by seizethecheese on Tuesday November 17, 2026 @01:28PM
(#50535938)
No. I'm personally building agentduel.com, specifically with this problem in mind (benchmark performance not matching real world usage). It's generally accepted by HN community to make relevant comments about your own projects, as long as its not hamfisted.
[ Parent
| on HN ]
Using non-native harnesses sort of throws a wrench in things. I pretty sure your benchmark would look much different if outputs came from their intended harness.
Re:GPT‑6.2 Astra and Sol
by seizethecheese on Tuesday November 17, 2026 @02:39PM
(#50537015)
[delayed]
Re:GPT‑6.2 Astra and Sol
by arcanemachiner on Tuesday November 17, 2026 @02:20PM
(#50536743)
It certainly does get tiresome though.
Re:GPT‑6.2 Astra and Sol
by seizethecheese on Tuesday November 17, 2026 @02:37PM
(#50536980)
Certainly does. See my comment here roasting this extremely BS blog post that is basically an ad: https://news.ycombinator.com/item?id=50532191.
Do my comments get tiresome, though? None have been downvoted to hell, since they are all adding to discussion. If you think so feel free to email me, I don't want to be annoying.
Yeah, maybe one thread per article will do?, otherwise it comes across as shilling
Re:GPT‑6.2 Astra and Sol
by seizethecheese on Tuesday November 17, 2026 @02:38PM
(#50536993)
Fair enough, though all the comments have either 1pt or positive karma, so I take that as a signal that they're adding value so far. I'll take a coffee break, though, hah.
Genuinely, just excited about what we're building and think it adds information about these models that are missing.