News for hackers. Stuff that matters.
Re:CheatGPT by JohnFen on Monday February 20, 2023 @07:29PM (#34874841)
An LLM will never be able to produce something that cannot be statistically derived from its training data.

So... creating a new language, maybe?

Re:CheatGPT by neongreen on Monday February 20, 2023 @07:41PM (#34874930)
https://maximumeffort.substack.com/p/i-taught-chatgpt-to-inv...

My bet would be that in ten years GPT would get pretty good at it, but eh, I dunno.

Re:CheatGPT by iameli on Monday February 20, 2023 @07:39PM (#34874922)
ChatGPT's attempt: https://gist.github.com/iameli/d9a5b715ec9baa5b11063888e054d...

Are those two responses enough to say it's invented a language? Probably not. But it's already farther along than I would have gotten if you asked me to do such a thing.

If I kept prompting it for hours, I bet it would start to contradict itself and lose track of the rules it had already established, but so would I. If I were actually inventing a language, I'd take months and keep extensive cross-referenced documentation on grammar and syntax and vocabulary. We don't _let_ ChatGPT do that, it has no mechanism for persisting its ideas like that. But like... neither would I if you took away my notebook and the parts of my brain that persist long-term memory.

I guess my interpretation here - I see differences in _capabilities_, but not differences in actually _intelligence_.

Re:CheatGPT by jesterman on Monday February 20, 2023 @07:53PM (#34875043)
I see what you are going with here for it not being able to come up with original things. But I think that falls apart when you realize almost nothing humans do is original, everything is just building on other things.
Re:CheatGPT by JohnFen on Tuesday February 21, 2023 @11:25AM (#34882957)
The vast majority of what people do is this, yes. Just like how most of the time, we're all running on autopilot and our behaviors are pretty much just following scripts. "Meat robots".

But it's not 100%.