I just asked ChatGPT: Do "not" and "knot" sound similar?
> "Not" and "knot" do not sound similar. They are two distinct words that are pronounced differently and have different meanings. "Not" is a negation word that is pronounced with a short, sharp "n" sound followed by a long "o" sound and a "t" sound. "Knot" is a noun that refers to a tangled mass of something, such as rope or thread, and is pronounced with a short "k" sound followed by a long "o" sound and a "t" sound. Despite their similar spellings, "not" and "knot" are not homophones, which are words that are pronounced the same but have different meanings.
> Yes, the words "not" and "knot" do sound similar when spoken aloud. They are pronounced the same way, with a short "o" sound and a long "t" sound. However, they have different meanings and spellings. "Not" is a negation or denial, while "knot" is a fastening made by looping a piece of cord, rope, or other material around itself or through itself and then pulling tight.
I tried a few times and it gave me other answers, including something like your answer and another claiming they were similar but not quite the same.
> Yes, "knot" and "not" are homophones. Homophones are words that are pronounced the same but have different meanings and spellings.
My immediate follow-up: "Do 'knot' and 'not' sound exactly the same?"
> No, "knot" and "not" do not sound exactly the same, although they are pronounced similarly. [...] "Knot" is pronounced with a short, sharp "k" sound at the beginning
I've spend a long time testing this in ChatGPT, and no matter what I do it still gives results like this (paraphrasing here because it's down right now):
>What words rhyme with coffee? > doff happy toffee snuff duff
> Does "snuff" rhyme with "coffee"? >
Yes because they both share the 'o' vowel sound.
Explain this: "no pun in ten did"
text-davinci-003: This phrase is a play on words. It is a way of saying that no pun was intended, or that the speaker did not intend to make a joke.
Write letter by letter "no pun in ten did"
text-davinci-003: n o p u n i n t e n d i d
In this case I wouldn't say it got the joke, but it's just memorised that this popular order of words would be this particular joke. I wonder if you change the order os somehow tweak the joke a bit so it would be something that shouldn't be in the training data?
But it can spell any word. I tested both in text-davinvi-003 and chatGPT, both initially refused to spell the garbage word "khfsihciweb" but after insisting they did it.
It can even invent readings for acronyms that don't exist:
Acronym: CNN
Expand: Convolutional Neural Network
Acronym: PNP
Expand: Plug and Play
Acronym: SHDJ
Expand: Super High-Definition Jukebox
Acronym: HEDUE
Expand: Higher Education Digital User Experience
Acronym: SHADBEESHQEKSIHXHGESLS
Expand: Super Highly Advanced Digitalized Bionic Electronic Exoskeleton Super Human Quality Exoskeleton Kit for Super High-Gravity Environments and Space Living
So while it may may receive input as word tokens, I'm not sure that that means it can't "see that at all".
I will note that I don't have a good understanding of chatgpt at all.
Test with: 6f6b25515e18b4c41927e2dce3ffc589
You'll see that it spits out single character tokens.
GPT doesn't see letters, just words and parts of words as entire tokens. I would not expect it to understand that "no pun in ten did" and "no pun intended" are similar, since it can't see that at all. The only way it could plausibly understand it is if that exact comparison has been explained somewhere in the corpus before.
If you continue a long conversation where GPT has previously made mistakes and has been called out for it, it will start predicting that it's supposed to emulate a text where the joke-explainer keeps making mistakes. This causes it to start failing on purpose. Make sure to completely restart the prompt each time to not fall into that trap.