GPT-5: Key characteristics, pricing and system card

Re:GPT-5: Key characteristics, pricing and system card by umanwizard on Thursday August 07, 2025 @01:45PM (#44827773)

What is METR?

[ Parent | on HN ]

Re:GPT-5: Key characteristics, pricing and system card by ravendug on Thursday August 07, 2025 @02:26PM (#44828452)

https://www.lesswrong.com/posts/deesrjitvXM4xYGZd/metr-measu...

[ Parent | on HN ]

Re:GPT-5: Key characteristics, pricing and system card by tunesmith on Thursday August 07, 2025 @02:21PM (#44828385)

The 2h 15m is the length of tasks the model can complete with 50% probability. So longer is better in that sense. Or at least, "more advanced" and potentially "more dangerous".

[ Parent | on HN ]

Re:GPT-5: Key characteristics, pricing and system card by Leary on Thursday August 07, 2025 @02:07PM (#44828172)

https://metr.github.io/autonomy-evals-guide/gpt-5-report/

[ Parent | on HN ]

Re:GPT-5: Key characteristics, pricing and system card by wisemang on Thursday August 07, 2025 @08:10PM (#44831957)

To maybe save others some time METR is a group called Model Evaluation and Threat Research who

> propose measuring AI performance in terms of the length of tasks AI agents can complete.

Not that hard to figure out but the way people refer were referring to them made me think it stood for an actual metric.

[ Parent | on HN ]