I think in your rush to respond you may have accidentally made a solid point against your argument.

No not really. The people that are behind the LLMs don't really know why it keeps getting better with more compute and data, they are literally just trying shit. Yet, the world has seen just how useful the thing is. We don't have any assurances from the damn thing, yet it's the most useful thing we ever made (at least software-wise).