Re:3Blue1Brown: Visualizing Attention, a Transformer's Heart
by mjburgess on Tuesday April 16, 2024 @02:18AM
(#40048885)
You need some way of inducing distributions in reality, ie., making the ice cube.
If you're just subject to time-varying, random, stochastic, perceptual distributions you have no way of estimating the properties of the data generating process (reality).
You need to be the one in control of the distribution in order to study it: this is the lesson of the whole history of science as an experimental discipline.
RL is doing just this, simulating an environment. And we can have an agent "learn" in that environment.
I think tying learning to a body is too restrictive. The
You strongly rely on the assumption that "something else" generates the statistics we observe, but scientifically, there exists little evidence whether that "something else" exists (see eg the Bayesian brain).