Re:Sam and Greg's response to OpenAI Safety researcher claims
by plaidfuji on Saturday May 18, 2024 @09:02PM
(#40403333)
Interesting, gpt-4o took seven tries to do this, and I had to give it very specific feedback about what it was doing wrong. Here was the answer:
Level says keyboard broke down today, needing repair within five anyway.
Re:Sam and Greg's response to OpenAI Safety researcher claims
by gwern on Saturday May 18, 2024 @10:31PM
(#40403725)
GPT-4o still uses BPEs.
Re:Sam and Greg's response to OpenAI Safety researcher claims
by sashank_1509 on Sunday May 19, 2024 @11:09AM
(#40407437)
I would prefer if it can give the number 5 instead of five. Also I don’t like to tell it what exactly it got wrong, just that it got it wrong. Saying things like think step by step, focus on rules etc is all fair game, while saying “keyboard is the second word, not third”, imo is not. I tried quite a bit when I saw this example on twitter and could never get it to work.
Re:Sam and Greg's response to OpenAI Safety researcher claims
by croemer on Saturday May 18, 2024 @09:36PM
(#40403464)
Is this correct? First try ChatGPT4: "Anna uses keyboard swiftly without missing five anyway."
Prompt exactly yours: https://chatgpt.com/share/ff3169cb-0d45-4cdb-bf18-bc552ad697...
Woop, I forgot about the odd number of words.
Re:Sam and Greg's response to OpenAI Safety researcher claims
by npinsker on Saturday May 18, 2024 @08:48PM
(#40403282)
gpt-4o produced a correct sentence first try for me
“ Write a sentence that has an odd number of words, with the third word being "keyboard", the last word being "anyway", the next-to-last word being a number, and the first word being a palindrome “
Do we have to add these examples to the dataset now, so that they can solve this? Then maybe we find another prompt and add that too, as a human I’ve never seen such a question before, why do I seem to be able to do it so easily? We are creating some form of intelligence that will have a massive economic impact, but I doubt we are creating human like intelligence that has the ability of being far better than humans along every dimension, which is what super intelligence is