News for hackers. Stuff that matters.
Re:On Chomsky and the Two Cultures of Statistical Learning by dragonwriter on Thursday March 09, 2023 @12:17PM (#35083687)
> Had he said "not ONLY a statistical engine for pattern matching," I would agree.

I’m not sure I would even then. I mean maybe, but that’s not the clearest, most certain, fundamental difference.

A more clear fundamental difference is ChatGPT instances are all, metaphorically, instinct with no space for intelligence. They have lots of “training”, but that all happens before they are capable of acting, and once they are capable of acting their behavior is entirely preprogrammed based on a very small input window. They have no memory of experience (that’s simulated, within the token limit, between the model and the user for chatbots), much less a reward mechanism that would let them learn behavior from experience.

There are no comments on this comment yet.