Re:GPT‑6.2 Astra and Sol
by tedsanders on Tuesday November 17, 2026 @01:24PM
(#50535868)
I work at OpenAI and I made the plots. Gemini 4 Carbon was omitted when we couldn’t find public data, usually cost. No intent to hide anything.
[ Parent
| on HN ]
Re:GPT‑6.2 Astra and Sol
by underdeserver on Tuesday November 17, 2026 @01:36PM
(#50536071)
So all the plots are based off public data? You don't run the models internally yourselves?
(Again speaking only for myself)
Re:GPT‑6.2 Astra and Sol
by BoorishBears on Tuesday November 17, 2026 @02:33PM
(#50536928)
Non deterministic models = "oh look they put up a lower score than Google did for that bench!"
Re:GPT‑6.2 Astra and Sol
by declanjackson on Tuesday November 17, 2026 @02:32PM
(#50536913)
All TB-Science scores and Cost per Task (across all reasoning levels for Carbon) are on AA: https://artificialanalysis.ai/evaluations/terminal-bench-sci...
Would be great to see this on the plot as well