That’s the steelmanned argument at least.
The storing of that can take up precious resources, to create service droids that can do everything using AGI we need the computer that runs it to be essentially the size of a real human brain. Which we need to find ways to map AI tech more closely to biology.
There's also the fact that we are born with instincts built up over millenia, passed down. We also absorb random tidbits of data with no actual purpose. We watch the news and our toddler gets excited at the commercials, I don't know what he's learning from it, but getting him to turn his attention away from it is nigh impossible.
You can see the processing going on, it's amazing to watch him learn. I just think we need to think outside the current ai 'boxes' with dl/ml and consider their may be whole swath's of things we're missing, whole pieces of the puzzle before we get to AGI or the Singularity.
Other than being unsubstantiated, the real world only runs at 1x, simulated world can run at any rate your computing platform supports.