Re:Teaching ChatGPT to Speak My Son’s Invented Language
by shagie on Monday April 10, 2023 @04:09PM
(#35516819)
Remember that GPT is working on input tokens and output tokens. Its output is tokens that then get converted back into text.
Taking [21063, 306, 11, 262, 479, 648, 38049, 45230, 1497, 11, 25071, 739, 262, 35560, 495, 6766, 13] to expect it to output back [13, 88, 591, 13724, 4496, 304, 4352, 2266, 28803, 19967, 541, 330, 325, 837, 88, 6909, 390, 381, 1219, 267, 273, 4660, 461, 304, 4352, 837, 2645, 74, 979, 84, 48] is a difficult problem that it is not well suited for.
Re:Teaching ChatGPT to Speak My Son’s Invented Language
by cdelsolar on Monday April 10, 2023 @04:27PM
(#35516994)
It is insane that it can get that close, and it’s actually more impressive that it makes small typos than if it didn’t.
Re:Teaching ChatGPT to Speak My Son’s Invented Language
by chankstein38 on Monday April 10, 2023 @04:31PM
(#35517043)
right? It makes it feel like it's actually trying to do it versus just having some backdoor'd string reverse function
Re:Teaching ChatGPT to Speak My Son’s Invented Language
by chankstein38 on Monday April 10, 2023 @04:11PM
(#35516847)
That's because it's trained on the relations of words to each other and not on string manipulation. This is not its purpose. It may be capable of it to some degree but that seems like more of a luck of the draw kind of thing than something we should expect it to be good at.
I couldn't make it reverse that correctly even after prompting it five times to fix its mistakes.
Most commonly it writes: ".yks eruz a eht rednu gnipacse ,yawa depoh ooragnak eht ,ylkciuQ"
It also can't find the mistakes in there for the life of it.