Then recanted when we improved our knowledge of gravitation.
https://en.m.wikipedia.org/wiki/Vulcan_(hypothetical_planet)
I have always been a bit skeptical about it being some elusive magical new particle or somesuch though.
we're pretty sure our theories are right
People are always so sure.They didn't say "Well, the geocentric model is probably wrong but we'll use it for now" either.
I'm certainly not a physicist.
But instead, you could regard the observations as "experiments proving our theories wrong".
We already have weakly interacting particles like the neutrino, which don't interact with matter outside of the weak force, making them rather difficult to detect, it's not really that far out of the realm of possibility to have other particles that only interact via the gravitational force.
This is often mentioned as a reason not to spend time with alternative models. However, breaking stuff is sometimes necessary if we are to get out of the local maximum of theory usefulness. The Kopernik model was much worse fit for the observations of planet motion that the Ptolemy's model, but it did have other virtues, like simplicity. The broken parts got fixed later with development of mechanics and perturbation theory.
It does have some properties that we've managed to figure out, and they do look matter-ish.
Conjecting that the earth is round did not just explain why ships disappear behind the horizon. It also predicted that you can get back to point A by always moving away from it and many other phenomena.
And these not only are consistent with the existence of dark matter, but roughly indicate the same amount of it as a fraction of mass in the universe.
So I disagree strongly that the existence of dark matter hasn't led to other predictions. Indeed, the number of different phenomena that lead to it is one of those things that have made alternative theories so difficult. There are a ton of alternative gravitational theories that can explain one or two of the above phenomena, but trying to match them all (and not contradict other observations), seems to be somewhere between difficult and impossible.
The fact is that dark matter isn't just some half-baked theory that astrophysicists pulled out of their ass. Nor does it represent some lame attempt to just sweep complexity under the rug as if astronomers said "I dunno, probably magic", shrugged, and moved on.
Dark matter is a very specific and constrained theory that has withstood the test of decades of observational tests where all other theories have fallen by the wayside. Astrophysicists and cosmologists did not set out trying to force the theory of dark matter on the world, they have tried repeatedly to prove that other explanations could account for observational evidence, but none did. Instead they've had the reality of dark matter thrust upon them.
And it's not such a crazy theory either. We know that there are other kinds of weakly interacting massive particles such as neutrinos that exist in the Universe. And we know that our understanding of particle physics, the standard model, is incomplete. It is not a great leap to posit that potentially there are other types of weakly interacting massive particles that we have yet to discover. We know that neutrinos and "hot dark matter" does not make up the majority of the mass of dark matter in our Universe through several lines of observations. We know that baryonic (atomic) matter is also not dark matter as well. Only "cold" (sub-relativistic speeds) WIMPs fit the evidence for dark matter. The evidence gathered from galactic motion studies, gravitational lensing observations, simulations of the evolution of the large scale structure of the Universe, measurements of the cosmic microwave background, and many other experiments. Nothing fits all the data except the cold dark matter theory. That's why scientists believe it.
The fact that you are skeptical about it is irrelevant. Educate yourself on the evidence and science of it first, and then you can talk.
Scientists: Listen people! We have created models that explain why stuff does what it does! They are so complicated almost nobody can understand them. They involve 4 dimensions, a zoo of particles, randomness in everything and no reality independent of the observer. And they conflict. But at least they explain why stuff does what it does!
World: But they make the wrong predictions. Stuff does not behave like that.
Scientist: Oh, no problem. Just imagine there is an invisible force out there that moves stuff around. Imagine most of our universe is made of that invisible stuff. Now back to our awesome models!
We have well understood mathematical models which correctly and accurately predict all physical behavior relevant to our everyday lives, and, further, correctly and accurately predict the majority of our observations of the universe around us, period. As tools for understanding our world, they are incredible achievements.
In spite of us knowing these models to be fundamentally incomplete, we have yet (to my understanding) to perform an experiment on Earth which contradicts them. More to the point, the theory which supersedes them will, by virtue of needing to replicate all experimental results so far, will likely be even more esoteric, complicated, wild, baffling, and impenetrable (and--with any luck--elegant, inspiring, and beautiful).
accurately predict all physical behavior
Now you made me curious. What is the non-physical (metaphysical?) behaviour that we cannot predict?It's still fairly immature, so still needs work - it violates the equivalence principle and relies on Unruh radiation which hasn't conclusively been observed.
[1] http://physicsfromtheedge.blogspot.co.uk/2014/01/mihsc-101.h... [2] http://physicsfromtheedge.blogspot.co.uk/2016/09/mihscqi-vs-...
There are the arxiv papers and some other reports (that all tend to link back to either the blog or arxiv) as well. Like you, I don't have a strong physics background, so find the published papers a challenging read.