Markov Chains Are the Original Language Models

Re:Markov Chains Are the Original Language Models by marcus0x62 on Thursday February 01, 2024 @12:25PM (#39218516)

“A human brain is just like a dog’s brain, only with more neural pathways.” True, perhaps, but largely pointless: at some point neural complexity results in a difference of kind, not of degree.

I’d argue the same is true of LLMs vs simpler models like Markov chains.

[ Parent | on HN ]

Re:Markov Chains Are the Original Language Models by andoando on Thursday February 01, 2024 @03:48PM (#39221231)

I think this vastly underplays animals intelligence though. There is so much focus on creating human level intelligence, but where is a robot that can learn to navigate the world like a dog or cat can?

[ Parent | on HN ]

Re:Markov Chains Are the Original Language Models by marcus0x62 on Thursday February 01, 2024 @06:38PM (#39223081)

It was an analogy about how stupid it is to say a markov chain is “just like an LLM.”

[ Parent | on HN ]

Re:Markov Chains Are the Original Language Models by candiodari on Thursday February 01, 2024 @01:23PM (#39219315)

But a human brain is also just like an elephant or whale's brain except with 1/5th of the neural pathways at best, probably less.

There's a qualitative difference too.

[ Parent | on HN ]