If the article stuck to “we don't have any good reasons to believe that neural nets are conscious,” I wouldn't have had this objection. Either you get to say you know some properties about consciousness that allow you to coherently argue that some things are or are not, or you don't claim that and then you don't get to make that argument. The article wants to have its cake and eat it too, making a strong stance about what their model says while also claiming to neither have nor hope to have a model.
I do actually think there are useful things you can say about what is and isn't conscious, but my comments here aren't really about that, they are about this annoying argument style where you attack things from whether they conform to social norms, rather than the merits of the position.
Quite simply I don’t agree or disagree because the guy failed to clearly communicate.
Sure, no one knows what exactly consciousness is... or what slightly conscious is. The idea of protoconsiousness isn't that much of a stretch. If a biologist had suggested some plants have protoconsiousness, no one would have whined.
So what if someone working on NLP has an opinion about consciousness. Why is their opinion less valid than someone else's. It's not less informed.
Suppose you walked past a billboard that just said “Jump.” That’s grammatically correct and would be meaningful with context, but sitting alone you simply have no idea what idea was supposed to be communicated. Perhaps you missed a different sign, perhaps it’s art or an in joke, but sitting alone it’s simply ambiguous.
I think this still fails in the sense that the distribution representing one's beliefs is only defined with respect to a set of hypotheses. By invoking Bayes, presumably you acknowledge that different parties will come to the conversation with different priors. But critically, one can only update one's beliefs given both evidence and a likelihood function related that evidence back to hypotheses in the domain of one's beliefs.
The "our take" summary near the end of the article explicitly says that they would regard the claim as reasonable given the right explicitly definition of consciousness.
> The reality is that we don’t have a widely accepted definition, let alone understanding, of consciousness. Claiming that we have already replicated such a nebulous concept with computers seems improbable at best. Our take is that the claim could also be reasonable, but only if a particular definition of consciousness was specified as well.
Here's an opinion that 99% of people hold (or 99% of those within a field - same effect). You want to persuade someone to not hold it? Better have evidence.
It's not exactly that the burden is on the one making the claim, or on the one denying the claim. The burden is on the one who is trying to change minds from their existing beliefs. That one needs something convincing - principles, reason, or evidence, with evidence being the best.
Do you think AI has a sense of awareness?
I can't see one reason to ascribe a sense of awareness to any current form of AI, as world-changing and amazing as it is already. Even the I in AI tugs at me because I feel it might be a metaphor taken literally. As in, McDonalds is a hamburger empire but surely not a real empire. AI "knows" something in a way similar to how the dictionary "knows" the definition of a word. Beware of taking metaphors literally; there be dragons (but not real dragons)! AI has advanced beyond symbolic processing, it processes information in fantastic new ways, but it strictly speaking understands nothing. We take the processed information and we understand it (or don't). But maybe there's a case to be made that I'm being unfair, and it's actually justifiable to say that AI "thinks" without being conscious, aware, or sentient.
On panpsychists, if their heady intuition is somehow not deluded and a form of awareness or consciousness is a fundamental quality of matter or in some other way ubiquitous, maybe like "The Force" in Star Wars, that's clearly not the way that people would mean conscious here. An appropriate way to discuss AI in that context would be, "AI is slightly conscious just like everything else." And if consciousness were somehow a quality of all matter it still wouldn't mean that, say, a chair is conscious as a chair or a tokamak as a tokamak, or even a carrot as a carrot, but rather that the matter that makes up those things and everything else has some kind of awareness.