Re:Weird GPT-4 behavior for the specific string “ davidjl”
by weinzierl on Thursday June 08, 2023 @12:59PM
(#36245092)
It's still a mystery to me. It seems be able to ASCII encode and do Ceasar Ciphers including ROT13 perfectly. I tried to get it to answer with words beginning with alternating even and odd letters. No dice.
[ Parent
| on HN ]
Re:Weird GPT-4 behavior for the specific string “ davidjl”
by Vecr on Thursday June 08, 2023 @01:58PM
(#36245964)
That's probably because the model works on tokens and not letters. Depending on what "it" means, the model can use various tokenization methods that you can run on your computer really easily so you can see what it sees.
Re:Weird GPT-4 behavior for the specific string “ davidjl”
by weinzierl on Thursday June 08, 2023 @02:13PM
(#36246212)
Sure, but the tokenization should cause problems for the encoding and cipher tasks as well? In addition to that: The odd/even starting letter task should be solvable by only considering tokens since the first letter should fall on the beginning of the token.