From the description in the Wikipedia article, we’ve already reached the point where it’s quite interesting. An nVidia card and an iPhone are pretty clearly not intelligent (although the iPhone tries a bit harder).

But these same devices, running the right software and given the right parameters, do something that seems impressively close to intelligence. And I suspect that my brain, with its software somehow removed, would not seem very intelligent.

On the other hand, a human baby will spontaneously generate language and intelligence, and I haven’t heard of a language model doing that. (The experiment has, sadly, been done. https://en.m.wikipedia.org/wiki/Nicaraguan_Sign_Language )

As someone that studied philosophy as well as computer science in college and had to hear many times people asking why I study philosophy at all, this is why.

Philosophy often asks questions that are not yet reached by current technology but will be soon enough.