These kludges are slowly getting better: maybe you can get a menu bar app so you can control your lights from the computer, maybe your phone/tablet light app can stick some buttons in an Android widget or in the iOS notifications pulldown, there are even people trying to make switches that you can stick over the normal switches and hit to trigger light changes without having to hire/be an electrician who can replace the switches.
It's a widget in your notifications bar and your lock screen with buttons for remote control. Also has a smartwatch app. I use it all the time and it's so much faster than the official Hue app.
And I wrote a little app that lives in my Mac's menu bar and lets me pick from the scenes I set up in the official app, too, someday I should actually package it up properly. (https://github.com/egypturnash/weatherlight)
But yeah, 90% of the time, if I am turning on a light, I'm hitting the physical switch. So a bulb that is ignorant of my switch's position isn't a lot of use to me. Because if I want to turn that bulb on... my switch is probably already off. And the bulb can't work if the physical switch is off.
I might get some more bulbs (mi.light) if I start finding more uses but for now it seems pretty niche.
And doesn't involve a wall switch.
Of course, a fully integrated system with switch/dimmer modules in the electrical system is nice, but not really an option in many situations (e.g. renters). Control purely by a phone is certainly not ideal, but is a simplest useable solution you can build on, with additional hardware, apps for special functions, ...
Exchanging batteries in additional lightswitches seems stupid, but doesn't happen THAT often. You can add them if you want them, others make do with the phone and maybe NFC tags or other tricks.
Sure, if I owned the place or would be staying here for many years it might be worth it, but not yet.
These basic sets require very low effort to get started, and THEN people are interested.
I hope I got my point across better now, it's kinda late here.
Even today, I have the ability to control nearly all the lights on the main floor of my house with an app on my phone. I actually use this feature maybe once or twice a year, being generous. Even if my phone is on me and already unlocked (due to being in my house), I have to pull it out, swipe the screen, launch an app, wait for it to load, then find the lights I want and click to turn on. Or I can press the switch on the wall next to me.
Or, even better, a timer/motion sensor has already turned on the light for me and I don't even have to think about it. This is what real home automation is all about.