If an AI created this simulation but is not actively part of it (I do think free will is an important component of the simulation), could we discover a way to import it?
If so, we'd only need to be able to open a passthrough and we'd have authentic AI well beyond anything we could hope to achieve within the next few centuries at least.
Along these lines, I think it's interesting to ask: "if we are in a simulation, what determines randomness?" In theory, a qubit in a superposition has two possible outcomes of equal weight. But why does it end up being one or the other?
Arguably, if our own consciousness is a manifestation of that AI, we might be able to answer how to import it by better understanding how we ourselves make decisions. Where does that embodiment of free will originate as a physical event, and could we recreate that physicality artificially? Would such a setup end up producing random junk, or a cohesive output?
Regardless, as others have stated in this thread, if we know we are in a simulation, we'll likely shift how we approach multiple domains, particularly in the sciences. And it's very likely that if we are currently coming to realize that we are in a simulation, that's the whole point.
Just because DNNs are hot right now doesn’t mean much. If you follow machine learning long enough, you’ll see hype cycles for various techniques. Neural nets used to be hot in the 80s, until they weren’t, and now they are again. Something else will come along soon enough. We use the techniques we do usually because the math works out, not because it’s anything like how our brains work.
In the first case, your new argument does not make sense, because the complexity of implementation does not matter to the result, and there's a clear improvement to it.
In the second case, I can assure you lots changed. The recent major things being ReLUs, self-supervised learning and attention mechanisms.
What test is there to quantify understanding that has been used to determine that it hasn't gotten better?
It seems to me that a lot of the things that are posed as hard things for AI to do are poorly defined phenomenon which we have no empirical test for that we simply infer to be explanations for observed behavior of humans that critics assert that AI can't do without evidence or even a definition upon which a search for evidence could be based.
we don't, but this is simply the faulty 'god of the gaps' reasoning applied to neural nets instead of deities. It doesn't really provide any insight or value to believe that neural nets are supposed to somehow magically solve problems they apparently can't solve.
Neural nets already consume significantly more compute and energy than even primitive biological agents with significantly worse results, so it appears to be very obvious that they aren't the whole story.