News for hackers. Stuff that matters.
Re:GPT‑6.2 Astra and Sol by tedsanders on Tuesday November 17, 2026 @01:24PM (#50535868)
I work at OpenAI and I made the plots. Gemini 4 Carbon was omitted when we couldn’t find public data, usually cost. No intent to hide anything.
Re:GPT‑6.2 Astra and Sol by underdeserver on Tuesday November 17, 2026 @01:36PM (#50536071)
So all the plots are based off public data? You don't run the models internally yourselves?

(Again speaking only for myself)

Re:GPT‑6.2 Astra and Sol by BoorishBears on Tuesday November 17, 2026 @02:33PM (#50536928)
Non deterministic models = "oh look they put up a lower score than Google did for that bench!"
Re:GPT‑6.2 Astra and Sol by declanjackson on Tuesday November 17, 2026 @02:32PM (#50536913)
All TB-Science scores and Cost per Task (across all reasoning levels for Carbon) are on AA: https://artificialanalysis.ai/evaluations/terminal-bench-sci...

Would be great to see this on the plot as well