News for hackers. Stuff that matters.
Re:What ChatGPT Can't Do by logicallee on Saturday December 24, 2022 @07:59PM (#34122927)
ChatGPT seems to have a layer to tokenize at the word level. It doesn't really understand letters or characters in a word. It's also really bad at counting.

This example combines two things it is bad at (letters in a word and counting). It is better not to do that.

Re:What ChatGPT Can't Do by chatgptexpert on Saturday December 24, 2022 @11:20PM (#34124216)
I found it really good at counting. I asked it to count the number of nouns, adverbs, and adjectives in the lyrics of a song, and it got it 100% right.

Of course it understands letters or characters. You can ask it for a list of possible tokenization of a word and it will list them out. You can then refer to this list and refer to different tokens of the word and it will correctly modify the word according to the token. The trick is that you need to emphasize the idea of a token into its current context. That will make the concept relevant for your current prompt.

You have to nudge it in the direction you want, don't assume it always knows what you are talking about.

Re:What ChatGPT Can't Do by mycall on Sunday December 25, 2022 @11:33AM (#34128552)
Don't they use word2vec?