Re:3Blue1Brown: Visualizing Attention, a Transformer's Heart
by andoando on Monday April 15, 2024 @04:32PM
(#40045210)
Im working on a model to do just that :) The game of life is not too far off either.
Re:3Blue1Brown: Visualizing Attention, a Transformer's Heart
by Gooblebrai on Monday April 15, 2024 @05:29PM
(#40045837)
You might enjoy his next book: Reality Switch.
Re:3Blue1Brown: Visualizing Attention, a Transformer's Heart
by phrotoma on Tuesday April 16, 2024 @07:45AM
(#40050813)
Definitely way out there and later chapters are what I can only describe as wild conjecture, but I also found it to be full of extremely accessible foundational chapters on brain structure and function.
In one part he talks about a thought experiment modeling the universe as a multidimensional cellular automata. Where fundamental particles are nothing more than the information they contain. And particles colliding is a computation that tells how that node and the adjacent nodes to update their state.
Way out and not saying there's anything truth to it. But it was a really interesting and fun concept to chew on.