News for hackers. Stuff that matters.

A comment on GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text. Parent comment

Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by andai on Sunday December 03, 2023 @09:25AM (#38507274)
GPT-3 (ChatGPT) also succeeds at deciphering your example text. I didn't think it was that impressive until I realized the tokens were going across word boundaries like you said.
[ Parent | on HN ]
Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by dragonwriter on Sunday December 03, 2023 @04:32PM (#38510974)
> GPT-3 (ChatGPT)

ChatGPT's lower model is GPT-3.5-turbo, it is not GPT-3.

[ Parent | on HN ]
Re:GPT-4 Can Almost Perfectly Handle Unnatural Scrambled Text by andai on Tuesday December 05, 2023 @08:14AM (#38530282)
GPT-3 was silently replaced with RLHF'd ("instruct") versions (while keeping the same model names in the Playground) because they were cheaper to run (and had better "safety").

I think this means that current GPT-3 is more similar to GPT-3.5-turbo than to old (retired) GPT-3, but I'm not entirely sure about the details.

[ Parent | on HN ]