Having models doesn’t imply what you probably mean by “knowing about physics”, it just means having a representation of something that is not that something (like a map of the world is a map, not the world)
So, depending on how the dog’s understanding of the world works, it maybe doesn’t need any models, I can’t really know
But I do know, that if I want to describe anything, using any symbols whatsoever, then I’m implicitly creating a model of what I’m trying to describe with the symbols
So, if I’m trying to communicate and understand physical phenomena using AI, then I’m implicitly creating a physics model, whether I want to call it that or not
No. That's precisely the issue here. NN's do not "model the world" in anything remotely like the traditional meaning of that term.
Modelling the world historically means identifying objects/phenomena and proposed causal relationships between them. Without the relationships - e.g. if we add heat to the system, it will move more - there's no model. You may still be able to get predictions, and they may still be useful, but you are not defining a model.
To train a NN you need a training set of data, that data follows a certain order or pattern that represents the model that the person has
As long as the NN behaves as expected by the person setting it up, then it is useful as a model
How useful? That depends on what you are trying to do, your model and the data
If you want to take it to its extreme, all language is a model. Even what I’m expressing right now with this text. It’s just a model of what I’m thinking and the meanings I’m trying to convey
I have been repeatedly assured by people who manage to sound authoritative about NN's and ML here on HN that, despite my instincts to the contrary, this claim is no longer true. I continue to doubt it, but there you have it.
Your claims about language are quite interesting, and quite controversial.
What is the goal of that NN? How are inputs and output of that NN defined?
If you define any structure or properties of the NN, or any description at all, you are implicitly creating a model. Any NN is already a model
Not sure why that would be controversial
Now our lead experimenter asks this person "what will happen if the global average temperature increases by N degreesC?" and they get an answer.
Can we way that the lead experimenter has built a model? They have not, certainly not in the sense that they have any access to it. The person who replaced the NN may have (and indeed, probably has) built some sort of model, but that's a very different claim.
Explainability in NN/ML systems is a hot topic, and many people (not all!) would say that if the NN/ML system cannot explain why adjusting parameter X will cause changes in parameters A, M and T, then you have no access to anything that merits being called a model.
A consequence of this is that if the person who replaced the NN can explain themselves (e.g. answer the X -> A,M,T coupling), then even the experimenter can probably be said to "have a model". But if all that can be said is "I don't know and/or I can't explain, you just need to trust me that this coupling is real", then the claim that a model has been built is on unstable ground.
What symbols or language did the lead experimenter use to ask the person the question? And what does degrees, temperature and global mean?
All of those things require models to be communicated between the components of your system
Any symbolic communication is necessarily a model of what it is trying to represent
Of course, if there isn’t someone to interpret it, it’s just symbols. But to interpret a meaning behind symbols, then it implies the symbols represent a model of the meanings that are being communicated
The insight gained by rigorously modeling a system in computer code produces a person (the modeler) who can provide valuable insight when asked questions about the system. In policy analysis, the modeler’s insight can often provide quick and dirty and auditable (and often correct) analyses/answers about the modeled system without ever running the developed formal computer model. The exercise of the formal development of a computer model credentials the modeler as having gained a level of rigorous systems-level expertise. And the scope and detail of that modeler knowledge is certified in the depth and breadth of the computer model itself (and the currency and accuracy of the input data sets).
Nice to have such an human analyst around when important policy decisions need to be made, since such policy decisions should be made and implemented by humans who can explain the confidence that exists regarding the knowledge that supports the given decision. The decision makers can then point to the analysts for the estimate of the degree of confidence that can be ascribed to the policy analysis that supports the decision. That’s how it’s supposed to work, and that philosophy is formalized in existing decision processes for complex technical systems such as transportation, telecommunications, power, military systems, etc.. You know, the important stuff….
The training data could be real physics in a simulator held up against evolutionary driven AI logic that competes against it with various goals that are then evaluated and if given a high score then marked as isomorphic and given enough runs you'd get a dataset.
What is “the underlying process”?
For example, Newton was able to model gravity quite successfully without ever being able to “understand the underlying process”. In fact, physics today still doesn’t have a good grasp on what gravity is. Yet we use the models and equations all the time
In a way, physics is also a collection of black boxes, perhaps just seemingly more elegant boxes
Newton realized that these phenomena could be explained as arising from the same underlying process of an inverse square law. This is a much more useful model, and allows predictions that allow us to do things like space flight, even if it is not complete.
It's not useful to draw a false equivalence between AI-style "the model predicts, that's good enough" and science as a whole which cares very much about the underlying structure.
If anything, AI researchers are digging deeper into the models too
And people in physics are starting to use AI tools to model physical phenomena
I think that it’s a never ending task to understand all the black boxes. Definitely not possible by a single person. But also at some level you get to circular references. There is no fixed point in the universe, there is no point 0 or origin that we can find. Everything is relative to something else
What if the hammer gets angry and starts hitting us in the head? How can you not see the danger in getting hit in the head by a hammer?
This is all just short term noise and no one will ask these stupid questions soon enough. In the meantime, it makes for good theater on podcasts.
IMO -
The simple ones: advection, latent heat release/absorption from water changing phases, and the Coriolis force. If you need an AI for this, please take a course on differential equations.
The hard ones: droplet/ice crystal formation, cloud feedback on radiative transfer, evaporation at air-sea boundaries. If you can train a model for these processes, please, please tell someone.
Not exactly. The particular symbols used in mathematics may be arbitrary but the mathematical structures and relationships are not.
There’s some interesting research on how the limits of predictability may come down to what is mathematically provable in a formal system. That may sound kind of weird, but consider that any computable model can be modeled as a Turing machine, which is essentially a process that manipulates symbols according to a set of rules—not too different than mathematics itself. The difference is that based on certain assumptions of internal consistency (that cannot be proven if the system is in fact consistent), the mathematical manipulation of symbols can be used to make predictions about the behavior of Turing machines. There’s a very deep connection between the two and neural networks are still just another form of this, perhaps not as human-interpretable however.
Interestingly though, physical models are usually expressed as mathematical equations. Which is an arbitrary way of modeling
A Neural Network could technically “discover” different models, just through optimizing predictions for whatever we want the model to do
We might not be able to distill the NN into nice compact equations, but they might still form a pretty good model of whatever phenomenon is fed to it through observational data
Note that just by picking the input data and the output expectations, we are already defining a model