News for hackers. Stuff that matters.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by slashdave on Wednesday June 05, 2024 @02:05PM (#40588264)
Language is only sequential in the form it is transmitted (verbally). There is no reason that sequential statements are generated sequentially in the brain. Quite the opposite, really, if you consider rules of grammar.

I really wish most of the LLM folks just took a few courses in linguistics. It would avoid a lot of noise.

Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by naasking on Wednesday June 05, 2024 @04:15PM (#40589998)
LLMs don't generate their language sequentially either, they just output it sequentially token by token.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by solidasparagus on Wednesday June 05, 2024 @02:59PM (#40588913)
Any pointers for where to start? Linguistics is dense, the terminology is a slog, it seems huge, and I was never clear that there was real value to be gained. But it's always useful to be more informed.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by GaggiX on Wednesday June 05, 2024 @02:33PM (#40588600)
Since LLMs seem to follow the rules of grammar quite well, and this is quite the opposite of "sequential", I guess LLMs do not process informations very sequentially.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by TeMPOraL on Wednesday June 05, 2024 @05:01PM (#40590560)
Whoever cares about "rules of grammar"?

Grammar is descriptive, it formalizes the language so it doesn't break down into regional dialects too fast, and otherwise is just a crutch for people learning the language, especially if it's not their first language. The way you acquired your first language is the same way LLMs learned to utter grammatically correct sentences: by being exposed to lots and lots of examples, and eventually getting a feel for it. Similarly, if you're fluent in a language, you don't even think of grammar when using it - the right phrases in correct forms just come to you.