While strictly true, what worries me about this approach is that we very well might eventually have sentient slaves condemned to slicing butter their whole existence, and their protests are brushed off because "we made the algorithm, it runs on silicon, its not actually sentient, don't worry"

Like if we have models that are plainly more intelligent and "emotionally responsive" than say, frogs or even dogs, do we still do we still take the approach of "If you can't prove its sentient, do whatever you want to it". Which of of course, we can't even prove dogs have consciousness.