It's pseudoscience because there's nothing in the geometrical properties of those images called "gravity", etc. One can generate those pixel patterns from an infinite number of theories with an infinite variety of causally efficacious parameters.

From the article, it doesn't work. They found on known physics it gives 4.7 dimensions, of which only two are explicable -- 4 is correct; the others have no known physical interpretation. No surprises: those two are just the geometric properties of the system (angles) which are actually properties of the image. The others are pure bullshit.

Since, of course, the real physical parameters of the system we take to have generated those images are not present in them. The images are distal effects of these things

Only in cases where the geometric properties of the target system are causally relevant to its actual causal properties will this work -- ie., only when "angles matter"

Thinking you can infer laws of nature from images is pseudoscience, and these guys need to think more carefully about why we experiment in the first place

eg., Consider that if mass is a relevant causal property, there'd be no way of inferring it from images: two objects can be visually identical whilst having radically different masses... making images *OBVIOUSLY* not a measure of mass...

this project almost defines the modern kind of schizophrenic pseudoscience born of this wave of AI

It also incidentally underscores the amazing predictive powers of Noam Chomsky, when he thinks he's describing something that common sense indicates is dumb, and then a few years later someone actually goes out and does it, and does it in earnest, and unironically, and tries to promote it as an actual advance:

So for example, take an extreme case, suppose that somebody says he wants to eliminate the physics department and do it the right way. The “right” way is to take endless numbers of videotapes of what’s happening outside the video, and feed them into the biggest and fastest computer, gigabytes of data, and do complex statistical analysis — you know, Bayesian this and that [Editor’s note: A modern approach to analysis of data which makes heavy use of probability theory.] — and you’ll get some kind of prediction about what’s gonna happen outside the window next. In fact, you get a much better prediction than the physics department will ever give. Well, if success is defined as getting a fair approximation to a mass of chaotic unanalyzed data, then it’s way better to do it this way than to do it the way the physicists do, you know, no thought experiments about frictionless planes and so on and so forth. But you won’t get the kind of understanding that the sciences have always been aimed at — what you’ll get at is an approximation to what’s happening.

http://chomsky.info/20121101/

But he's saying it is bad to do it that way instead of doing traditional physics because you get no understanding, which is true, but in this study they're not using it as a "physics engine" to pilot aircraft or whatever, they're using it as a trick to generate novel hypotheses, which could then be theorised and investigated properly, not as a replacement to theory.

Its worse than that. It doesnt actually work.

Unless you have videos of experiments designed to observe measurement devices we have created, on systems we have designed, it's all useless.

The only useful thing in figuring out how nature works is creating truely novel experimental circumstances and measuring them with novel devices created for that purpose.

You cannot do science as a statitics of images; that's pseudoscience. And chomsky is here only half-right; it's actually much worse than he's sayign.

I think I understand your criticism. There is no inherent ground truth in the image. The mass example is great since a 2D plane can't capture the quantity mass it's literally impossible the dimensions don't work. At best a 2D plane could show you correlations of mass (mass vs something plotted out). Hence this is just modern AI aka pattern-matching on steroids.

I think a counter argument would be that if there is SOME signal in the photos AND there's enough training data that does have the correct ground truth signal that the scientists are matching up then you can have SOME level of accuracy. If the training set can reasonably cover the space of possibility that we're interested in then we can get reasonable interpretations.

However in this case the insane number of physical phenomena will always be larger than any training set so this approach should NEVER generalize there will always be way too much noise which is what the scientists have figured out here. So I agree with you that it's extremely limited but I don't think I'd call it pseudoscience there might be very limited domains where for example the only data we have available are images and so such a tool may be appropriate.

I definitely share your frustration though since any half way decent scientist should have just done a thought experiment instead and figured that this wouldn't work well. This smells like BS academic marketing where they always inflate their own impact and significance.

Who cares if there's no gravity? Gravity wasn't sent down to us from heaven on a stone tablet, it's just a concept that lets us make predictions. At school I was taught it was a force and at university I was taught it was a pseudoforce resulting from fixing a non-inertial frame. Both approaches give correct answers, even though they're conceptually very different. There's no objective way to say which is right; they're just different approaches to modelling.

And maybe the 4.7 is actually more correct? The 4-parameter model is an approximation that neglects friction and air resistance. Moreover the double pendulum is a chaotic system and chaotic systems sometimes have dynamics described by laws with non-integer exponents such as Lyapunov dimension. I'm just spitballing, but the point is that it's not a priori ridiculous.

It's definitely possible to estimate mass from images. How do you think we know the masses of asteroids and planets? No-one put them on a scale, we just record their motion and work out which value fits best.

> Who cares if there's no gravity? Gravity wasn't sent down to us from heaven on a stone tablet, it's just a concept that lets us make predictions.

A concept that says gravity is the result of bending spacetime, with the speed of light being constant. It's not just a model, it's saying the universe is 4D spacetime, which explains why GR is so predictive.

It is just a model though! Everything in science is just a model. We better hope it's just a model, because it's incompatible with quantum field theory, which is another very accurate model. The only consistent model that bridges the two, superstring theory, says that spacetime and gravity could fundamentally be many things, from closed strings travelling between D3-branes to the holographic projection of a conformal theory - and you still get the same predictions.

I show someone a photo of a bowling ball and a styrofoam ball of the same shape and size. If someone thinks they can infer from a simple visual scan of the scene (analyzing the factors you see) are they delusional?

Perhaps they could leverage their lifelong training set which correlates scenes that look like they have bowling balls with scenarios that have a high mass movable sphere.

Perhaps we could have a good laugh together by painting a bowling ball to look like styrofoam and painting styrofoam to look like a bowling ball- then we could watch the silly ai/human apply an incorrect mental model and fail to grasp the causal reality! Ohohoho

None of this works without astrology, since it was the guiding theory behind Brahe and Kepler's measurements. The out-of-sample training data that Newton used for confirmation was comet orbits. Would ML really have created an elegant, closed-form theory about the elliptical shape of orbits and the power-law dependence of the period? Without these insights, there would be no inverse-square law in the first place, and perhaps we would only have an effective theory.

I think you're confusing Astronomy (studying celestial objects) with Astrology (divinatory practices related to celestial objects).

Granted, the reason why people did Astronomy was because they believed in Astrology, but it's no longer been the case since a while.

The purpose of Brahe's measurements, and the reason he hired Kepler, was to gather data for astrological predictions. The principles of astrology led them to look for simple, basic principles in a way that a computer would not, unless directly programmed to do so. The astronomical measurements alone were not enough.