There's a quote attributed to Donald Knuth that goes "Science is what we understand well enough to explain to a computer. Art is everything else we do."

Now if you take the word "explain" broadly and maintain that we've actually found a way to "explain" a huge volume of information to GPT-3 then you might hold that Knuth had got it backwards.

But maybe that's the crux of it. GPT-3 doesn't get explained anything. You might better say it was force fed.