News for hackers. Stuff that matters.
Re:Teaching ChatGPT to Speak My Son’s Invented Language by chankstein38 on Monday April 10, 2023 @03:57PM (#35516686)
You're trying the old primary school method of testing things based on the wrong criteria. Why does it need to play tic-tac-toe, hangman, or rock paper scissors? Why do you think a language model would be good at those things?

Similarly, why would you expect a thing trained on the context of text would be good at reversing strings? It's amazing it's as good as it is at these things because it doesn't really make sense that it could do these things unless they trained it on reversed strings to add diversity but it's hard to gain context from a string backwards.

ALSO: your transcript doxs you and is hard to tell where your messages end and GPT begins. Just a heads up in case you don't want your full name leaked to whoever reads this

Re:Teaching ChatGPT to Speak My Son’s Invented Language by localplume on Monday April 10, 2023 @04:24PM (#35516962)
Because those games are just a way to measure how an internal state changes with moves initiated by the ego and initiated by someone else. The point is that there is no consistant internal state because it hallucinates and spotaneously changes. its like telling the language model a story, and getting it to repeat certain facts about it or you make additions to the story. its the exact same thing. It needs quite a lot of "prompt engineering" to push it in the correct direction, and even then its frequently incorrect.
Re:Teaching ChatGPT to Speak My Son’s Invented Language by og_kalu on Monday April 10, 2023 @05:12PM (#35517469)
Re:Teaching ChatGPT to Speak My Son’s Invented Language by jhanschoo on Tuesday April 11, 2023 @12:00AM (#35520654)
The idea for games is that these are simple games, presumably with complete descriptions from various sources already in their database. The test is of their reasoning ability and ability to generalize descriptions into tasks that aren't chimeras of examples already in their database, y'know, like a classic test of what we'd call raw reasoning and intelligence, not crystallized intelligence.

With reversing strings unfortunately it's not likely to achieve that considering its tokenization.