Re:Pause Giant AI Experiments: An Open Letter
by avereveard on Thursday March 30, 2023 @07:14AM
(#35370903)
You have control of the model. You can make it always pick the most likely choice, you can also have it penalize token that it had already emitted or that are common in the corpus. Chatgpt by default and choice has some more creativity backed in, but in the chat api where you can control the tunables you're going to find what you're looking for
Re:Pause Giant AI Experiments: An Open Letter
by ModernMech on Thursday March 30, 2023 @07:20AM
(#35370951)
I do, but this thing is going from 0 to world-scale use in a matter of months. It's not being used like you imagine if you think people are choosing their completions.
Except it doesn't even do that. Sometimes it decides to go for a less probable option, and goes from there even if it's logically completely wrong. For example, I asked it to generate a sequence of topics for a course. It starts off great with intro topics, and then the topics get progressively more advanced. But then suddenly lists an intro topic it had already listed, before going back to advanced topics.
What it did was it took an alternative completion from the most likely in that moment, even though logically it was 100% not likely. That's why you can't tryst anything this technology outputs for now. If you ask it what's 1 + 1, 99% of the time it'll tell you 2, but sometimes it'll tell you 3 and then argue with you about why it's 3.