News for hackers. Stuff that matters.
Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @02:14PM (#40577350)
At some point we always need some sort of model of the world, you don’t want to call it physics?, that’s fine, but you are still modeling the world

Interestingly though, physical models are usually expressed as mathematical equations. Which is an arbitrary way of modeling

A Neural Network could technically “discover” different models, just through optimizing predictions for whatever we want the model to do

We might not be able to distill the NN into nice compact equations, but they might still form a pretty good model of whatever phenomenon is fed to it through observational data

Note that just by picking the input data and the output expectations, we are already defining a model

Re:No physics? No problem. AI weather forecasting is already... by akira2501 on Tuesday June 04, 2024 @03:15PM (#40577950)
My dog knows nothing about physics. He's an expert at catching frisbee's though. The problem is he chases anything that looks remotely like a frisbee.
Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @06:42PM (#40579700)
My comment was in the context of the article, which states that AI doesn’t need physics

Having models doesn’t imply what you probably mean by “knowing about physics”, it just means having a representation of something that is not that something (like a map of the world is a map, not the world)

So, depending on how the dog’s understanding of the world works, it maybe doesn’t need any models, I can’t really know

But I do know, that if I want to describe anything, using any symbols whatsoever, then I’m implicitly creating a model of what I’m trying to describe with the symbols

So, if I’m trying to communicate and understand physical phenomena using AI, then I’m implicitly creating a physics model, whether I want to call it that or not

Re:No physics? No problem. AI weather forecasting is already... by PaulDavisThe1st on Tuesday June 04, 2024 @03:30PM (#40578116)
> but you are still modeling the world

No. That's precisely the issue here. NN's do not "model the world" in anything remotely like the traditional meaning of that term.

Modelling the world historically means identifying objects/phenomena and proposed causal relationships between them. Without the relationships - e.g. if we add heat to the system, it will move more - there's no model. You may still be able to get predictions, and they may still be useful, but you are not defining a model.

Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @04:15PM (#40578495)
I’m saying the person setting up the NN is doing so by following some model of what outputs to expect from the inputs

To train a NN you need a training set of data, that data follows a certain order or pattern that represents the model that the person has

As long as the NN behaves as expected by the person setting it up, then it is useful as a model

How useful? That depends on what you are trying to do, your model and the data

If you want to take it to its extreme, all language is a model. Even what I’m expressing right now with this text. It’s just a model of what I’m thinking and the meanings I’m trying to convey

Re:No physics? No problem. AI weather forecasting is already... by PaulDavisThe1st on Tuesday June 04, 2024 @05:07PM (#40578952)
> To train a NN you need a training set of data, that data follows a certain order or pattern that represents the model that the person has

I have been repeatedly assured by people who manage to sound authoritative about NN's and ML here on HN that, despite my instincts to the contrary, this claim is no longer true. I continue to doubt it, but there you have it.

Your claims about language are quite interesting, and quite controversial.

Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @06:10PM (#40579475)
Ok, let’s say you don’t need data

What is the goal of that NN? How are inputs and output of that NN defined?

If you define any structure or properties of the NN, or any description at all, you are implicitly creating a model. Any NN is already a model

Not sure why that would be controversial

Re:No physics? No problem. AI weather forecasting is already... by PaulDavisThe1st on Wednesday June 05, 2024 @10:25AM (#40585176)
No, you obviously need data. But several times when I've challenged the unacknowledged role that data pre-identification and classification is playing, I've been told that this isn't needed any more. You can just throw unorganized, unclassified data at these things (so they claim), and it will "figure it out".
Re:No physics? No problem. AI weather forecasting is already... by JulianChastain on Tuesday June 04, 2024 @04:06PM (#40578424)
A charitable interpretation of nico is that he was saying a well-trained NN is itself a model of the world. If it can tell you what a system will do given some inputs, then it functions as a model. While internally it isn't creating a model that we could understand, it does "model the world" in the sense that we can treat it as a model
Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @04:15PM (#40578500)
That’s an excellent interpretation. Thank you
Re:No physics? No problem. AI weather forecasting is already... by PaulDavisThe1st on Tuesday June 04, 2024 @05:12PM (#40579000)
Consider for a moment replacing the NN with another person, who forms a model of the world that is very useful for prediction.

Now our lead experimenter asks this person "what will happen if the global average temperature increases by N degreesC?" and they get an answer.

Can we way that the lead experimenter has built a model? They have not, certainly not in the sense that they have any access to it. The person who replaced the NN may have (and indeed, probably has) built some sort of model, but that's a very different claim.

Explainability in NN/ML systems is a hot topic, and many people (not all!) would say that if the NN/ML system cannot explain why adjusting parameter X will cause changes in parameters A, M and T, then you have no access to anything that merits being called a model.

A consequence of this is that if the person who replaced the NN can explain themselves (e.g. answer the X -> A,M,T coupling), then even the experimenter can probably be said to "have a model". But if all that can be said is "I don't know and/or I can't explain, you just need to trust me that this coupling is real", then the claim that a model has been built is on unstable ground.

Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @06:04PM (#40579423)
> Now our lead experimenter asks this person "what will happen if the global average temperature increases by N degreesC?" and they get an answer

What symbols or language did the lead experimenter use to ask the person the question? And what does degrees, temperature and global mean?

All of those things require models to be communicated between the components of your system

Any symbolic communication is necessarily a model of what it is trying to represent

Of course, if there isn’t someone to interpret it, it’s just symbols. But to interpret a meaning behind symbols, then it implies the symbols represent a model of the meanings that are being communicated

Re:No physics? No problem. AI weather forecasting is already... by onecommentman on Tuesday June 04, 2024 @09:22PM (#40580528)
A truism in the computer modeling communities of the 1970s and 1980s was “the product of a modeling exercise is not the computer model, but the modeler”.

The insight gained by rigorously modeling a system in computer code produces a person (the modeler) who can provide valuable insight when asked questions about the system. In policy analysis, the modeler’s insight can often provide quick and dirty and auditable (and often correct) analyses/answers about the modeled system without ever running the developed formal computer model. The exercise of the formal development of a computer model credentials the modeler as having gained a level of rigorous systems-level expertise. And the scope and detail of that modeler knowledge is certified in the depth and breadth of the computer model itself (and the currency and accuracy of the input data sets).

Nice to have such an human analyst around when important policy decisions need to be made, since such policy decisions should be made and implemented by humans who can explain the confidence that exists regarding the knowledge that supports the given decision. The decision makers can then point to the analysts for the estimate of the degree of confidence that can be ascribed to the policy analysis that supports the decision. That’s how it’s supposed to work, and that philosophy is formalized in existing decision processes for complex technical systems such as transportation, telecommunications, power, military systems, etc.. You know, the important stuff….

Re:No physics? No problem. AI weather forecasting is already... by nico on Wednesday June 05, 2024 @12:26AM (#40581407)
This is an awesome concept. Thank you
Re:No physics? No problem. AI weather forecasting is already... by PaulDavisThe1st on Wednesday June 05, 2024 @10:24AM (#40585161)
All of which is precisely my point ... the NN/ML pathway does not lead to a modeller who can provide valuable insight when asked about the system.
Re:No physics? No problem. AI weather forecasting is already... by universa1 on Tuesday June 04, 2024 @02:25PM (#40577468)
in some sense yes, and if you are only interested in good predictions this might work out well. What, maybe due to my limited understanding, is, that this is not theory driven and therefore does not really provide understanding of the underlying process.
Re:No physics? No problem. AI weather forecasting is already... by MyFirstSass on Tuesday June 04, 2024 @04:04PM (#40578396)
Wouldn't you be able to somehow couple it with another model that takes the NN data and somehow untangles it's convoluted logic into an isomorphic human readable equation, ie. a model that has one task and that is translating NN logic into human equations.

The training data could be real physics in a simulator held up against evolutionary driven AI logic that competes against it with various goals that are then evaluated and if given a high score then marked as isomorphic and given enough runs you'd get a dataset.

Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @04:28PM (#40578617)
Very cool idea! I wonder how simple could the NNs be to model some basic physical process?
Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @03:08PM (#40577885)
> and therefore does not really provide understanding of the underlying process

What is “the underlying process”?

For example, Newton was able to model gravity quite successfully without ever being able to “understand the underlying process”. In fact, physics today still doesn’t have a good grasp on what gravity is. Yet we use the models and equations all the time

In a way, physics is also a collection of black boxes, perhaps just seemingly more elegant boxes

Re:No physics? No problem. AI weather forecasting is already... by SaberTail on Tuesday June 04, 2024 @03:30PM (#40578112)
Gravity can be modeled as "things on the earth's surface accelerate downward at about 10 m/s², regardless of their mass". This works very well. Gravity can be modeled as "planets orbit the sun according to Kepler's laws". This also works very well.

Newton realized that these phenomena could be explained as arising from the same underlying process of an inverse square law. This is a much more useful model, and allows predictions that allow us to do things like space flight, even if it is not complete.

Re:No physics? No problem. AI weather forecasting is already... by jprete on Tuesday June 04, 2024 @03:57PM (#40578326)
Physics wants to open the black boxes until it can no longer figure out how to pry the remaining boxes open!

It's not useful to draw a false equivalence between AI-style "the model predicts, that's good enough" and science as a whole which cares very much about the underlying structure.

Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @04:22PM (#40578559)
Why are you assuming that people want to stop understanding the AI models?

If anything, AI researchers are digging deeper into the models too

And people in physics are starting to use AI tools to model physical phenomena

I think that it’s a never ending task to understand all the black boxes. Definitely not possible by a single person. But also at some level you get to circular references. There is no fixed point in the universe, there is no point 0 or origin that we can find. Everything is relative to something else

Re:No physics? No problem. AI weather forecasting is already... by hierophantical on Tuesday June 04, 2024 @11:58PM (#40581241)
I mean how can we ever trust a microscope when the human eye can not see at that level of magnification?

What if the hammer gets angry and starts hitting us in the head? How can you not see the danger in getting hit in the head by a hammer?

This is all just short term noise and no one will ask these stupid questions soon enough. In the meantime, it makes for good theater on podcasts.

Re:No physics? No problem. AI weather forecasting is already... by lainga on Tuesday June 04, 2024 @03:26PM (#40578068)
> What is “the underlying process”?

IMO -

The simple ones: advection, latent heat release/absorption from water changing phases, and the Coriolis force. If you need an AI for this, please take a course on differential equations.

The hard ones: droplet/ice crystal formation, cloud feedback on radiative transfer, evaporation at air-sea boundaries. If you can train a model for these processes, please, please tell someone.

Re:No physics? No problem. AI weather forecasting is already... by danielmarkbruce on Tuesday June 04, 2024 @03:38PM (#40578172)
"what is the underlying process" is another way of saying, all we have is models. We don't really understand anything. Even gravity. Yet, we can model gravity extremely well for practical purposes.
Re:No physics? No problem. AI weather forecasting is already... by nico on Tuesday June 04, 2024 @04:25PM (#40578583)
Exactly. Taking it further, I don’t understand how my hands work. Yet here I am typing away, without even having a good model for it, except just the language I’m using to describe what I’m doing
Re:No physics? No problem. AI weather forecasting is already... by Mathnerd314 on Tuesday June 04, 2024 @02:53PM (#40577747)
I think at some point it is worth admitting that there are variables you can't account for. Like the precise geography - the models model an area 1 mile square as a single vector, maybe even more coarse. They don't model every tree, rock, and bush. In a neural net you can just have "weight goop" which accounts for the net effect of these unmodeled features, but in a traditional model adding "fudge factors" and extrapolating back from the model to points of interest is tricky.
Re:No physics? No problem. AI weather forecasting is already... by bongodongobob on Tuesday June 04, 2024 @02:34PM (#40577560)
I think we understand the processes just fine. The issue is that we can't get a "closed form" solution for 10^100 interactions per planck time.
Re:No physics? No problem. AI weather forecasting is already... by gowld on Tuesday June 04, 2024 @04:43PM (#40578739)
That's like saying chemistry has nothing to understand because we know Schrodinger's wave equation. Or that we understand biology and psychology just for for the same reason.
Re:No physics? No problem. AI weather forecasting is already... by bongodongobob on Tuesday June 04, 2024 @08:05PM (#40580169)
Yeah, I think that makes sense. Those systems are similar in that they are made of zillions of tiny parts and there's no way to pull a one equation to rule them all out of it. We could, given infinite compute, but it's just not feasible.
Re:No physics? No problem. AI weather forecasting is already... by Xcelerate on Tuesday June 04, 2024 @04:52PM (#40578812)
> Interestingly though, physical models are usually expressed as mathematical equations. Which is an arbitrary way of modeling

Not exactly. The particular symbols used in mathematics may be arbitrary but the mathematical structures and relationships are not.

There’s some interesting research on how the limits of predictability may come down to what is mathematically provable in a formal system. That may sound kind of weird, but consider that any computable model can be modeled as a Turing machine, which is essentially a process that manipulates symbols according to a set of rules—not too different than mathematics itself. The difference is that based on certain assumptions of internal consistency (that cannot be proven if the system is in fact consistent), the mathematical manipulation of symbols can be used to make predictions about the behavior of Turing machines. There’s a very deep connection between the two and neural networks are still just another form of this, perhaps not as human-interpretable however.