News for hackers. Stuff that matters.
Re:Show HN: Sup AI, a confidence-weighted ensemble (52.15% o... by siliconc0w on Friday March 27, 2026 @02:01PM (#47546122)
Do you have data for other benchmarks? +7% for HLE isn't nothing but it'd be more compelling if you could show you're consistently doing better with your method across more domains (especially coding, which seems like the primary use-case these days).
Re:Show HN: Sup AI, a confidence-weighted ensemble (52.15% o... by kenmu on Friday March 27, 2026 @03:52PM (#47547394)
As of right now, we do not. I'm working on these other benchmarks, but unfortunately they cost quite a bit of money to run, which I'm hoping will come from many people using Sup :)