The problem with this kind of criticism of any AI-related technology is that it is an unfalsifiable argument akin to saying that it can't be "proper" intelligence unless God breathed a soul into the machine.

The method is irrelevant. The output is what matters.

This is like a bunch of intelligent robots arguing that "mere meat" cannot possibly be intelligent!

https://www.mit.edu/people/dpolicar/writing/prose/text/think...