News for hackers. Stuff that matters.
Re:Qwen4-Max by zozbot234 on Monday November 16, 2026 @04:35AM (#50515726)
> So what is happening is that models are broadening difficult-to-reason-to skills on benchmarks. ... If I'm being impolite I'd say the frontier models are trying to make sure they'll pass the "gotcha" interview questions for many jobs.

These "gotcha" skills will be needed for frontier research/scholarly tasks. It makes sense to focus on these now that traditional domains like coding or frontend design are broadly saturated (i.e. Astra- or Fable-level outcomes) even by lower-tier open models.

Re:Qwen4-Max by spwa4 on Monday November 16, 2026 @05:34AM (#50516089)
Real "gotcha" skills, yes (perhaps, they're gotchas because the underlying theory is not well understood. More can be achieved, certainly for superintelligence, by forcing understanding of the underlying theory rather than the gotcha). AND the incentives are totally misaligned.

"Gotcha skills", if we're going to call it that, are so popular because the AI labs are buying "tasks" to train on at huge prices, but mostly if they're gotchas.

The problem with that is that a collection of facts in the positivist sciences (and math) are always incomplete and almost preclude a full understanding of math, because it takes away the reason (to an extent) for full understanding.