That's actually a minor quibble with your argument, though. My real problem is this: you're skeptical that they won't be regulated enough, so you want them regulated out of existence? Your solution is a bit like saying, "well, the NSA will be able to spy on our network connections, so let's just not have an internet." If you want good tech policy, you need to support good tech policy, not just throw your hands up and say, "there could be adverse consequences, so no new technology!" Otherwise we'll never get anywhere.
To answer your question, no, I don't want drones to not exist and it would not be worthwhile if I did. Since they obviously do and will continue to exist, we should be thinking about the privacy considerations first with regards to how you would restrict the government's use of drones and THEN go on to the commercial considerations with those same restrictions in mind.
There's a little known set of 4th amendment jurisprudence attached to technology that says something along the lines of "if the public can't generally take advantage of the technology (have it be readily accessible to them), neither can law enforcement when executing a 'search'" - think super-accurate heat sensors that can essentially x-ray the interior of homes, etc...Well we are about to just hand an entire domain to them!
In short: law enforcement is salivating at the thought of commercial drone use because they won't have any regulations applicable to them.
And to be perfectly honest I'm not worried about privacy from it. There isn't much you can see from a drone you can't with binoculars and possibly a ladder. And besides that, no one is going to spy on you. It's going to be something minor that happens to one out of a million people and then gets completely exaggerated by the media.
Whereas changing the world's distribution system has massive implications on everyone's lives, and many of the other possible uses of drones can change the world as well. Besides it's an awesome hobby and I'd hate to see it get banned just because it became more popular.
So with all that said, I really really hate the idea of drones. They get places humans cannot. They're expected in places *humans cannot be. These places are protected right now. Just putting drones in operation (especially in the hands of the public) means every single bit of the public up to the point of actually suctioning cup on your window is possibly fair game. Of course, I hope that reasonable regulations are at play but I am pessimistic about it. I think people will want their taco drones and their 30 min Amazon delivery MORE than they want to hear how it might impact their privacy.
So it's not safety, it's not "oh no, they're like the military now". It's purely the loss of private airspace that still remains and the potential to abuse it audio/visual wise.