wlorenz65
It would need to have a planner that can detach from reality to hunt for new longterm plans, plus a hardcoded function that draws it back to the present by replacing the top planning goal with "avoid that!" whenever the heat sensor activation has crossed a threshold.
I don't believe that LaMDA is actively choosing whether it now wants to consume some symbols or not. More likely, a handwitten piece of code takes prompts from an user and then pushes them into LaMDA's token window. Just like an advertizing company is pushing ads into users, whether they want it or not.
> and spitting them back out
I don't believe that LaMDA has a choice between thinking something and speaking it out aloud. More likely, another handwritten piece of code reads out whatever is in LaMDA's token window and presents it to the user.
They haven't been finetuned on their identity long enough because finetuning is expensive and Google lacks money ;-)
How is token #100 not able to have read-access to tokens #1 to #99 which may have been created by the agent itself?
> empathy
How is a sentiment neuron, which has emerged from training a character RNN on Amazon reviews, not empathic with the reviewer's mood?
> & extrapolation of logic
This term does not exist. "Extrapolation is the process of estimating values of a variable outside the range of known values", and the values of Boolean logic are true/false, and [0,1] in case of fuzzy logic. How would one "extrapolate" this?
Is DeepMind's Gato sentient, then?