The internet is broken in China. Rather than an international internet, we've got a really fast domestic intranet. Not only is every cool, important site since 2004 blocked (e.g. Youtube, Facebook, Twitter, Dropbox...), but VPNs are less reliable than they used to be. Gmail is unreliable. Even paying for significant bandwidth, international sites are slow and video is a pain. I've seen an office full of really smart people's unproductive because they can't load a basecamp page or because dropbox transfers through a VPN move at a crawl.
Every time I go to HK, it's like a breath of fresh air having the internet. For this reason alone, I'd say don't do a start-up in China unless your market is China and you plan to be using primarily Chinese services.
As a software development consulting company, the pro is that there's a big market but if you want to do your own product then HK is the way to go...
Launching a web based product in China is dangerous because it's very hard to predict what will happen (you could be shut down by the government for one reason or another). Also cost of living and salary wise, Shanghai is anything but cheap (housing is cheaper than hong kong but the rest is not that much cheaper).
For the internet connection, it's manageable when using a ssh tunnel to a private server in the US... But it's a bit of pain (without that and tsocks even doing a bundle install in ruby takes a very long time and often times out)
That being said, big differences are the ease in setting up a company and costs. Ease of getting visas and the general paperwork. Also, HK is much safer than any of the mainland cities. The big cities are probably about similar to New York in terms of safety, but Hong Kong is ridiculously safe in comparison. There are basically no areas that you really shouldn't go to, and the medical system is quite good and reliable vs. mainland.
Also, one nice feature, no corporate tax if the income is from outside of Hong Kong.
However, I think China Government does welcome startups in Shanghai/Beijing with more goodies and support than Hong Kong's gov.
The occupy wall street people in Hong Kong are actually camped INSIDE the HSBC HQ building (granted, it's a special open-ground-floor building). But the sense that you get from HK is one of more freedom than the west, not less.
I spent 3+ weeks in HK in October of 2000 - but most of that time was partying - so I really didnt learn much about the place whilst there.
The Hong Kong Telecommunity Authority is, therefore, not required to implement the GFW.
Even in China, there are some GFW-free spots. You might find some 5-star hotels giving you unrestricted access to the likes of Facebook, Google+ etc
I've lived in HK during my student exchange and loved every minute of it - I also have an employee working from Hong Kong.
At some point I'll set up teams to target Asian markets with China as the most important one.
What are pro's and con's of HK vs Shanghai?
Edit: Thanks for all the answers! I really want to go back to HK now :)