Many of the papers go over my head at times of course (despite my interest, I'm firmly a layman!)
More generally, I've had a lot of success with searching for meta-analysis papers on topics I'm interested in, since the authors have already done the hard work of researching the literature and presenting core takeaways (as well as providing terms for more searches).
1: https://bsky.app/profile/abeba.bsky.social or https://twitter.com/Abebab
2: https://bsky.app/profile/olivia.science or https://twitter.com/o_guest
And the AI folks argued even then that the only way to create a language model that truly "understands" would be to put it in a robot that can experience the world in the same way as a human.
> I suspect the same thing would be true for attempts to develop AGI...
On the other hand, I would not be surprised if this did _not_ generalize and translate to LLMs. Biological entities on earth tend to have tons of fairly arbitrary developmental legacy which may or may not translate well to an artificial one. In the experiment, they didn't make billions of clones of the cat with a variety of different parameters and check which one worked, they just observed that yes, this standard v1 cat has some specific hard-wired developmental tendencies. It is not surprising that taking it out of the environment it was evolved for messes things up, but I would not take the extra step that this means that something is essential in general.
In school, we learn the lesson then get the test. In life we get the test then learn the lesson.
The Text is the environment, The Text is the world and they are very much interacting with it.
But then, is it ethical to build in pain receptors? Feels like we're brushing up against the territory of gods.
I ask this as I think the ethical dilemma should more about implementing suffering as a long term damaging effect of a stimuli.
When I think about pain I see it as a level that triggers a need to change something. Our brains are perceiving this level in a very uncomfortable way so we call this pain.
So I really think that without consciousness we cannot implement pain or suffering as we humans perceive it.
Perhaps, but I guess it would depend on your definition of consciousness. We do not extend that definition to most animals and yet they definitely feel pain.
You're right, the "feeling" of pain is ephemeral and hard to translate to a computer program. It would probably take a while doing potentially nasty experiments (to both man and machine) to nail it down.
I can't find the source for this, but I read about a rather unpleasant animal study in cats where they took two kittens. One was free to look around, but the other they immobilised in some way, and made it see what the other kitten saw as it looked around. They discovered the immobilised kitten did not develop normally whereas the mobile kitten did, suggesting that it's not just the sensory input, but it being feedback to some internal agency within the brain. I'll try to have another look to find the study later and update this post if I can.
I imagine that the same core insight may be true for attempts to develop AGI by giving them an audio-visual copy of a human's environment growing up: that internal state driving (and getting feedback from) the action to investigate/interact with the world is key.