When I say our measurement capabilities are limited, I mean that there are subsystems which are fundamentally chaotic. Small measurement inaccuracies will lead to large prediction inaccuracies, which in my view has little to do with intelligence.
I think the argument in the article is rather the other way around, ie that intelligence DEPENDS on a kind of simulation to develop proper intelligence. For instance AlphaZero was able to "solve" chess, go, etc, because it could simulate the game state perfectly.
And, the "hard" part comes from the fact that perfect simulation is impossible (with or without AI).
For an AI that will never interact with the physical world, this makes some sense.
However, as I argued in my other response, while some kind of World Model (ref LeCun) may indeed be necessary for AGI, it doesn't need to be perfect. Predictive about essential aspects (those relevant for decisions and actions) is enough.
https://syncedreview.com/2017/02/25/yann-le-cun-predicting-u...
I would argue that exactly the same goes for the human brain. Consciousness seems to play the part of the World Model for us. Between the quantum wavefunctions of the world we live in and our conscious experience (or even our sub-conscious data processing) there are layers-upon-layars-upon-layers of data loss and data compression/abstraction. Our sensory endpoints probably receive more raw data in a second than our consciousness processes in a year.
The reason it still works so well, I would argue, is a mix of darwinian learning that has been going on for hundreds of billions of years before humanity even appeared, where a data pipeline has been created in our hardware. This, combined with our ability to learn by interacting with the real world.
Creating an AI with a "perfect" world model is impossible. It will require more compute power than exists in the universe. Rather, AGI will need a simpler world model that captures the parts that are essential for its functioning, and that can be automatically updated using its input data (ideally sensors).
Just like us.
And, it seems to me, this is already happening. A self driving car will create an approximation for a 6-dimensional state for all objects (position and velocity), possibly with acceleration, speculation about intent or other "mental states. It will then extrapolate this a few seconds (or more) into the future, while keeping track of the confidence of the predictions.
This is a similar kind of world model that human brains seem to use, at least for the purpose of driving. Clearly, our brain needs a more complex model, since we make predictions much further into the future (such as the education of our children, or beyond) and we also interact with the world in more ways.
When AI systems start to make use of world model of the same complexity (type and level) as our own, and is able to "train" it both "genetically" and by standard "deep learning", I suspect it will be increasingly good at displaying what we consider "common sense".
And juding by recent developments, this could happens sooner than many think. If we're able to combine the features of ChatGPT, Tesla Self Driving, Stable Diffusion and perhaps a few other in a single model (that takes both visual data, sound and text as input, and which constructs a wold model that combines physical and abstract/textual/behavioral elements), this could happen within 10 years.
No matter how big computationally the AI is, the test was always trying to deal with something new, outside its comfort zone. Preferably as far outside it as possible. To do that successfully requires general problem solving and abstraction skills.
Of course one can do better or worse at that, including humans.
You cannot precompute most of the answer to a truly open question.
Ok so... a computer? Like how is this any different from the analogue between an actual physical, finite computer and a Turing machine?
> No matter how big computationally the AI is, the test was always trying to deal with something new, outside its comfort zone. Preferably as far outside it as possible. To do that successfully requires general problem solving and abstraction skills.
None of this has any material meaning. I'd love to see someone define what "general problem solving" and "abstraction skills" are—we can write those off as simple terms only because these concepts are how our brains already work. This doesn't mean we have any analytical understanding of these concepts. For one, there are already many algorithms that "recognize patterns" but we don't call that "abstraction skill", we call that an algorithm, or maybe a heuristic. So if you think this term is stably meaningful, what is your analytic understanding of "abstraction skill"? What are we abstracting? With what thing? With what processing? Where? In what context? You might as well say "well once we figure out language the rest of AI will be easy". Well, let me introduce you to the linguistic turn.[0] If we figure out how to process language semantically the way we ourselves do literally all the dominos fall into place. I suspect this won't happen in any of our lifetimes, at least not in any generally affordable way. At the end of the day humans mostly parameterize human data for computers and describe how to interact with it; the current forms of AI parameterize themselves based on data we feed it in the way we tell it to parameterize it, a form of parameterization itself. It is not any more interesting than composition. Language is the ultimate key to parameterization (and obviously algorithm writing but I'm much less interested in that as most humans are bad at writing algorithms of any complexity).
> You cannot precompute most of the answer to a truly open question.
Sure, but isn't that why we have all sorts of algorithms for searching for answers? Again, we don't refer to this as "intelligence", this is just "search". Or maybe you use "dynamic programming", or a "constraint solving algorithm". Whatever these techniques are called in traditional textbooks, we've really just ramped up uses of these algorithms combined with extremely complicated heuristics.... that are still heuristics.
I'm really pushing hard against this term because it really, really, really, really feels like a marketing term for suckers. If it were meaningful, the bounds on the term were probably discovered centuries, if not millennia, ago. The concept of "ai" seems to have been rewritten to mean "hot new algorithm that can be over marketed to imply far more functionality than we technically advertise we offer". I don't understand how the non-suits take the concept seriously. "AI" analytics companies are going to make a shitload of money off these rubes.
What would ACTUALLY BE USEFUL rather than pimping your software as intelligent would be establishing some kind of test to figure out whether or not we've hit AGI. Oh wait, we already have, and nobody's even come close.
And this WHOLE TIME we could have just used "machine learning"—which is both meaningful and an appropriate metaphor for the concept—but Spielberg never directed a movie named "M.L.".
Chess AI is nowhere close to this. They easily beat humans, yes, but in the game-theoretic sense chess is not solved.
the claim here is that applying physics/math/etc would be AGI-hard, because it involves the AI perfectly modeling a world it doesnt live in (the simulation problem) or understanding relationships in concepts without making jumps (obeying logic).