News for hackers. Stuff that matters.
Re:First Contact: The most important question in AI by MAESTRO1955 on Thursday July 30, 2026 @12:31PM (#49112296)
AI psychometrics becomes more important than its benchmarks.
Re:First Contact: The most important question in AI by adevalois on Thursday July 30, 2026 @03:04PM (#49114246)
I certainly agree. As we lose the ability to properly "test" these AI systems, we must focus more on how they behave. A system can ace every benchmark in existence and still be profoundly untrustworthy. I'm interested to hear from others if there are benchmarks that are immune to reward hacking or saturation.