News for hackers. Stuff that matters.
Re:GPT‑6.2 Astra and Sol by scilro on Tuesday November 17, 2026 @02:18PM (#50536704)
Only on max effort though. It seems to be alright at more common effort levels:

  Effort  Model          AA Index  TerminalBench  FrontierCode  $/task
  ------  -------------  --------  -------------  ------------  ------
  Medium  GPT-6.2 Astra      57.0          58.6%         46.6%    $1.62
  Medium  GPT-6.2 Sol        52.7          56.1%         41.4%    $0.41
  Medium  Opus 5.5           48.2          52.5%         33.1%    $2.45

  High    GPT-6.2 Astra      60.1          60.1%         47.1%    $2.07
  High    GPT-6.2 Sol        54.9          58.6%         40.2%    $0.56
  High    Opus 5.5           51.8          56.6%         35.9%    $3.46

  Xhigh   GPT-6.2 Astra      61.6          64.1%         49.0%    $2.52
  Xhigh   GPT-6.2 Sol        55.7          56.1%         42.8%    $0.65
  Xhigh   Opus 5.5           57.4          59.6%         43.8%    $6.05
But of course, benchmarks can't capture that "it factor."

There are no comments on this comment yet.