Demlolomot
Re:3Blue1Brown: Visualizing Attention, a Transformer's Heart
on Monday April 15, 2024 @09:27AM (#40040277)
My thinking is highly influenced by brain research.
We don't just talk about a LLM we talk about a neuronal network architecture.
There is a direct link to us (neural networks)
Re:3Blue1Brown: Visualizing Attention, a Transformer's Heart
on Monday April 15, 2024 @04:48AM (#40038178)
If learning in real life over 5-20 years shows the same result as a LLM being trained by billions of tokens, than yes it can be compared.
And there are a lot of people out there who do not a lot of reasoning.
After all optical illusions exist, our brain generalizes.
The same thing happens with words like the riddle about the doctor operating on a child were we discover that the doctor is actually a female.
And while llms only use text, we can already see how multimodal models become better, architecture gets better and hardware too.