News for hackers. Stuff that matters.
Re:FrontierCode by glerk on Monday June 08, 2026 @08:32PM (#48454489)
This looks really great, more thoughtful than any benchmark that I've seen until now!

I'm curious if you're only interested in scoring frontier models or you would accept submission from custom harnesses? I am working on multi-model harnesses and would love to test them against your benchmark. Do you plan on releasing the tasks publicly?

Re:FrontierCode by swyx on Tuesday June 09, 2026 @01:47AM (#48457002)
> Do you plan on releasing the tasks publicly?

yep

Re:FrontierCode by glerk on Tuesday June 09, 2026 @03:14AM (#48457677)
yay! looking forward, and thanks!