batavian
Conceptually the possibility of an AGI does present a real challenge (& one worth grappling); in practice, we haven't made any progress really toward realizing that problem. We've become good at feeding "large" datasets into algorithms that are many orders of magnitude less advanced than a lizard brain. Then we get to the issue that our large datasets are only large when thinking of classical statistical sample sizes. They nonetheless are lacking in redundancy, interactivity, stakes or any centered perspective such that there is no chance of anything resembling intelligence, agency, or plain old intentions arising.
But the mistake here (and some other comments) of drawing "lawmakers", "politics", etc as being conceptually distinct from private corporations is particularly absurd from a historical view. The Protestant Reformation and the Enlightenment forged political battles with substantial effort, debate, human cost that over centuries invented the concept you take granted as "companies", but which no other human civilization previous would have been familiar with. That there are "companies" at all is political, and so the OP is already pointing to a failure of politics.
Moreover, the vast majority of examples one can come up in science are not truths, and in fact a core premise of science is each state of scientific knowledge is contingent and not final, i.e. it's not True, but it should be a more faithful description of what is happening than we had before.
Law of causation, Doomsday argument, complex processes that can't be recreated, historical processes which leave faint empirical markers, etc.