News for hackers. Stuff that matters.
Re:November 2026 Claude Fable 5.2 Scores 65 on Artificial An... by rico735 on Monday November 09, 2026 @06:28PM (#50433861)
Out of interest, do you run the same tests more than once to generate that?

What I often observe is that models being asked the exact same prompt can alternate between getting something right and getting it wrong, thanks to the wonders of a non-deterministic output.

Re:November 2026 Claude Fable 5.2 Scores 65 on Artificial An... by dom96 on Tuesday November 10, 2026 @05:48AM (#50438487)
Yes, two runs per task.