News for hackers. Stuff that matters.
Re:GPT-6 Astra, Looped Transformers, and Hidden Reasoning by fragmede on Wednesday September 09, 2026 @03:13PM (#49632471)
We could still have soft evidence though. Make a Todo app on Monday, and make a Todo app on Tuesday, and see what it makes in comparison.
Re:GPT-6 Astra, Looped Transformers, and Hidden Reasoning by ArvidSu on Wednesday September 09, 2026 @03:45PM (#49633045)
You only need to come up with a catchy "SomethingBench" name, post it on reddit/x and now you're an ai sage. Not to disparage the launch/after comparison though, I'd genuinely enjoy a data point like that
Re:GPT-6 Astra, Looped Transformers, and Hidden Reasoning by marcus_cemes on Wednesday September 09, 2026 @03:41PM (#49632974)
You would need a significant sample size to make any sort of conclusion from such a probabilistic process. Then there's the issue of how you would actually grade/compare.
Re:GPT-6 Astra, Looped Transformers, and Hidden Reasoning by luckydata on Wednesday September 09, 2026 @03:50PM (#49633132)
someone already does that https://aistupidlevel.info/
Re:GPT-6 Astra, Looped Transformers, and Hidden Reasoning by chaimtweiss on Wednesday September 09, 2026 @04:48PM (#49634038)
It's actually a extremely cool site, and fascinating to view the results off the AI bots i use.