What you're describing is what's been proposed by Giulio Tonini as "Integrated Information Theory" (IIT) [1]. I quite like the framework and the math behind it is beautiful. Unfortunately, it hasn't been supported well empirically.
Re: AI, IIT actually gives basis for AI not being conscious. Not to mention that all conscious systems we can currently observe are dynamic/continuous, not discrete. The difference there is qualitative—there's no reason to assume that because a dynamic system is conscious that a discrete system approximating it is conscious too.
The article you cite [0] is labelled as "opinion". The standards for peer review of opinion articles in scientific journals are a lot lower than those for ordinary research articles. While precise standards vary from journal to journal, for opinion articles peer reviewers often see their role as simply excluding egregious misinformation and blatant errors, as compared to research articles where their role is to make sure the article is presenting high quality evidence in support of its conclusions. [1]
[0] https://www.nature.com/articles/nrn.2016.44
[1] https://ecologyisnotadirtyword.com/2021/02/24/lets-talk-abou...
https://journals.plos.org/ploscompbiol/article?id=10.1371/jo...
Scott Aaronson’s attempted refutation of IIT - https://scottaaronson.blog/?p=1799 - I think is better in that he actually tries to relate IIT to some of the philosophical literature (e.g. his distinction between Chalmers’ “Hard Problem” and the distinct “Pretty Hard Problem” which he sees IIT as trying to address)
I think it is a pity that Aaronson has never (to my knowledge) published his criticisms of IIT in a more formal setting-and I don’t know if Tononi has responded to them anywhere. I think Aaronson is probably right - that IIT fails as a mathematical model of what we intuitively consider conscious, since even though it excludes many common electronic devices we wouldn’t “conscious”, it is possible to mathematically construct an algorithm, capable of being physically implemented in electronics, which would be conscious per IIT but not per our intuition. And even if Tononi patches his mathematics to solve a particular case of that problem, someone with Aaronson’s skillset may just be able to construct another.
Tononi might then argue that if there is no mathematical model of our intuitions about consciousness lacking in special pleading, that’s a sign our intuitions are flawed. Okay, but then if we accept our intuitions can be flawed in some cases, why not in more cases? One could decide the intuition of consciousness is completely erroneous and become an eliminativist about it. Or, if IIT forces you to accept (contrary to our intuitions) certain (special cases of) simple electronic devices or computer systems as just as conscious as humans, why not violate those intuitions further and insist on that for even more cases?
My personal belief is that consciousness requires dynamic continuity. I don't think an algorithmic system is conscious because it's "cognition" is discrete and the information isn't integrated across frames. I don't have a "why that works"—its just a gut belief.
Consciousness is the emergent, graduated phenomenon of an information processing system when that information processing system has achieved significant complexity to model itself with relation to the various systemic inputs.
It's not binary, it's a gradient. I have more developed consciousness than my dog, which has more developed consciousness than a rat, and then a fish, then an insect, etc.
Somewhat disturbingly it also goes the other way, AIs may achieve a more profound conscious experience than humans - same for aliens. What does it mean for inferior forms of consciousness that have always placed themselves on a pedestal in relation to the rest of the animal kingdom simply because they have the most developed consciousness?