Three senior researchers have resigned from OpenAI

Re:Three senior researchers have resigned from OpenAI by mebutnotme on Saturday November 18, 2023 @03:17AM (#38316866)

I’d recommend trying to build out your systems to work across LLMs where you can. Create an interface layer and for now maybe use OpenAI and Vertex as a couple of options. Vertex is handy as while not always as good you may find it works well for some tasks and it can be a lot cheaper for those.

If you build out this way then when the next greatest LLM comes out you can plug that into your interface and switch the tasks it’s best at over.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by pjmlp on Saturday November 18, 2023 @03:41AM (#38317024)

Definitely, just like with games development, the key is to master how things work, not specific APIs.

AI tools will need a similar plugin like approach.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by quickthrower2 on Saturday November 18, 2023 @05:19AM (#38317726)

I have a good idea how transformers work and have written Python code and trained toy ones, but end of the day right now calling OpenAI nothing I can build can beat it.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by quickthrower2 on Saturday November 18, 2023 @03:38AM (#38317008)

The problem is swapping LLMs can require rework of all your prompts, and you may be relying on specific features of OpenAI. If you don't then you are at a disadvantage or at least slowing down your work.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by bongobingo1 on Saturday November 18, 2023 @03:42AM (#38317031)

Just ask the LLM to rewrite your prompts for the new model.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by worldsayshi on Saturday November 18, 2023 @03:55AM (#38317111)

Does it really have that kind of self awareness to be able to do that successfully? I feel very sceptical.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by Roark66 on Saturday November 18, 2023 @04:17AM (#38317288)

I doubt self awareness has anything to do with it..

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by worldsayshi on Saturday November 18, 2023 @06:27AM (#38318247)

What else would you call the ability for it to adapt a task for its own capabilities?

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by mkl on Saturday November 18, 2023 @07:49AM (#38318952)

Language modelling, token prediction. It's not much different from generating code in a particular programming language; given examples, learn the patterns and repeat them. There's no self-awareness or consciousness or understanding or even the concept of capabilities, just predicting text.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by worldsayshi on Tuesday November 21, 2023 @05:50PM (#38371645)

Sure but that kind of sounds like it is building a theory of mind of itself.

If it does have considerable training data including prompt and response when people are interacting with itself then I suppose it isn't that surprising.

That does sound like self awareness, in the non magical sense. It is aware of its own behaviour because it has been trained on it.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by irthomasthomas on Saturday November 18, 2023 @06:14AM (#38318125)

Just have it write 10 and bench them against your own.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by disconnection on Saturday November 18, 2023 @03:50AM (#38317076)

I have a hierarchy of templates, where I can automatically swap out parts of the prompt based on which LLM I am using. And also have a set of benchmarking tests to compare relative performance. I treat LLMs like a commodity and keep switching between them to compare performance.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by tin7in on Saturday November 18, 2023 @05:33AM (#38317835)

Just curious are you using something specific for the tests?

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by rlt on Saturday November 18, 2023 @05:06AM (#38317616)

Isn’t the expectation that “prompt engineering” is going to become unnecessary as models continue to improve? Other models may be lagging behind GPT4 but not by much.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by te_chris on Saturday November 18, 2023 @05:37AM (#38317874)

The dream maybe. You still have to instruct these natural language agents somehow, and they all have personalities.

[ Parent | on HN ]

Re:Three senior researchers have resigned from OpenAI by ramraj07 on Saturday November 18, 2023 @05:23AM (#38317758)

That would go as well as trying to write a universal android iOS app or write ansi sql to work across database platforms. A bad idea in every dimension.

[ Parent | on HN ]