News for hackers. Stuff that matters.
Re:This word does not exist by andybak on Tuesday October 26, 2021 @04:05PM (#29005574)
> the small number of bits that appear to make sense.

What I find most impressive is just how much of it's output appears to make sense.

Of course "make sense" is the critical part of this. It's skin deep - but still quite astonishing fairly frequently.

Re:This word does not exist by plutonorm on Tuesday October 26, 2021 @04:44PM (#29006032)
is it skin deep though?
Re:This word does not exist by andybak on Tuesday October 26, 2021 @05:03PM (#29006229)
Well it's certainly fragile and easily lost.

Are you implying some deeper understanding in GPT3?

Re:This word does not exist by plutonorm on Thursday October 28, 2021 @07:57AM (#29024992)
I agree it's fragile and dreamlike - but it is in my opinion genuine understanding. If you have or ever do have children you can observe them pass through a similar kind of stage, fractured incomplete understanding, dreamlike, yet still understanding. It crystallises slowly overtime. I predict the same will happen as we expand the models and add more complexity.