A few years ago, I would have agreed with you. The latest generation of flagship phone cameras (iPhone 8, Pixel 2, Galaxy S9) are comparable in quality to a good compact camera. I really can't see much difference between a modern smartphone and an old favourite like the Powershot S120. You wouldn't want to make big prints, but you can get genuinely good images from a flagship smartphone, especially with a third-party app like Camera+ or ProCamera.
Oh, right, the most important thing: almost everyone shoots portraits with smartphone cameras, which are too wide to give a flattering perspective (yes, even the 50mm equivalent "telephotos", which are also even worse cameras technically).
Camera doesn't mean much. I give my camera to random people and guess what, I get random photos exactly as if they were done with a smartphone.
It is not the camera, it is the photographer that takes the picture. The picture is the light field that was present at the moment of taking it -- your job as a photographer is to create or find an interesting light field and the camera is just technical means of preserving it. CAMERA WILL NOT MAKE YOUR PHOTO INTERESTING.
We're not talking about bad photographers here, we're talking about someone that knows what he's doing trying to use a smartphone camera seriously. All the skill and knowledge can't do much against rolling shutter or banding in gradients that should be smooth, etc.
My first camera I used when I started this hobby was Fuji X100. This has a lot of limitations. Extremely slow focus, fixed 35mm (equivalent) f2.0 lens. This forced me to study its limitations and what I can get with it.
I have quickly learned, it's not about being able to do everything, it is about being able to do something, very well.
In my experience the main limiting factors of smartphone are the tiny sensor size (noisy, low DR). Image processing keeps getting better but there are physical limits to what can be squeezed out of a given sensor.
If smartphones could trigger flashes at reasonable shutter speed (I guess 1/125 or 1/250) I could see myself using one to take real photos in an emergency.
There are also different definitions of what good gear is. I have several 40-60 year old lenses that are excellent for studio and street photography, but people who want edge to edge sharpness (blah blah blah) would probably laugh at them.
Which is another way of saying: smartphones tend to take pictures which are acceptable or good under a smaller set of viewing conditions than pictures taken by a skilled photographer operating an optically/electronically advantaged camera in equivalent circumstances.
That's not exactly a fair comparison. In a film camera, you're essentially replacing the "sensor" every time you add a new roll. '40s film (largely) has terrible dynamic range (far worse than an upmarket smartphone camera), is incredibly noisy under conditions smartphones can handle gracefully. Color film compatible with common cameras had only existed since 1930, and it remained disappointing well into the '70s.
Exotic gear only matters if your're trying to do something hard (for example big prints from 35mm film or extreme macro or high speed photography...) and I say this as a Contax/Leica/Hasselblad shooter/gear snob. Merely decent gear is important - smartphone pictures are universally awful when given a closer look.