News for hackers. Stuff that matters.

A comment on Can GPT-4 and GPT-3.5 play Wordle?. Parent comment

Re:Can GPT-4 and GPT-3.5 play Wordle? by putlake on Monday March 20, 2023 @11:31PM (#35242236)
You're absolutely right. It actually doesn't understand letters very well. See what happened when I asked it to give me seven-letter words that start with E and do not have the letter A: https://twitter.com/thisislobo/status/1638019231903264768

Spoiler: It gave me many words with the letter A. It also gave me an 8-letter word. When I pointed out the 8-letter word (exercise), it apologized for there being an A in exercise.

[ Parent | on HN ]
Re:Can GPT-4 and GPT-3.5 play Wordle? by ramraj07 on Tuesday March 21, 2023 @12:28AM (#35242567)
It’s more bad at math (especially counting digits or characters) than anything from my experience.
[ Parent | on HN ]
Re:Can GPT-4 and GPT-3.5 play Wordle? by ajuc on Tuesday March 21, 2023 @03:55AM (#35243541)
I found it interesting how it deals with rhyming in different languages.

It writes pretty good rhyming poetry in English, but in Polish it does poetry without rhymes. When confronted it gives excuses like "poetry doesn't have to rhyme", when asked to rhyme it will eventually try (and fail) to rhyme in Polish. It felt like it was writing in English and translating.

What's the most interesting is that rhyming in Polish is much easier than in English, you just have to match the last n letters. It's phonetic. After I explained that to GPT 3.5 it wrote rhyming poetry in Polish (the quality suffered but it did rhyme).

[ Parent | on HN ]
Re:Can GPT-4 and GPT-3.5 play Wordle? by stormfather on Tuesday March 21, 2023 @12:48PM (#35248872)
A funny example is playing hangman with it to get it to say something verboten. At the last letter it suddenly loses knowledge of how to spell completely.
[ Parent | on HN ]