News for hackers. Stuff that matters.

A comment on OpenAI threatens to revoke o1 access for asking it about its chain of thought. Parent comment

Re:OpenAI threatens to revoke o1 access for asking it about ... by huevosabio on Friday September 13, 2024 @04:31PM (#41534837)
My bet: they use formal methods (like an interpreter running code to validate, or a proof checker) in a loop.

This would explain: a) their improvement being mostly on the "reasoning, math, code" categories and b) why they wouldn't want to show this (its not really a model, but an "agent").

[ Parent | on HN ]
Re:OpenAI threatens to revoke o1 access for asking it about ... by andix on Friday September 13, 2024 @04:36PM (#41534883)
My understanding was from the beginning that it’s an agent approach (a self prompting feedback loop).

They might’ve tuned the model to perform better with an agent workload than their regular chat model.

[ Parent | on HN ]
Re:OpenAI threatens to revoke o1 access for asking it about ... by JasonSage on Friday September 13, 2024 @04:44PM (#41534943)
I think it could be some of both. By giving access to the chain of thought one would able to see what the agent is correcting/adjusting for, allowing you to compile a library of vectors the agent is aware of and gaps which could be exploitable. Why expose the fact that you’re working to correct for a certain political bias and not another?
[ Parent | on HN ]