If you insist on renting a nice 2bd aparment, you can do so for 2500 CHF in Zurich-city. If you move just slightly out of town, prices drop. I live on the southern end of town and my company is in the north. It takes me only 35 min to go through the whole city (Zurich is rather small).
In my opinion, cost-of-living averages give a misleading idea because people mentally give "cost of living" equal weight as to net-salary.
Although my life in Zurich costs more than my life in Munich, the ridiculous-high salaries and excellent working-conditions (I pay only 16% as taxes) make me feel that I win the lottery each and every month on pay-day. However, in case of sickness I would probably take a day off work and go to Germany (45 min trip) to go to the doctor there as doctors in Zurich also earn double as much.
My point being- I used to be able to save a tremendous amount of money; something like 65% of my after tax income, when I was single. Now that I'm married with two kids, I'm only able to save a much smaller 35%. I still live frugally, however, when you have young kids going to school, it's no longer possible to live like a monk. School is expensive, and kids are expensive to raise.
Cost of living is a very valid metric. At a minimum, it reflects the local property tax rates, which are basically the cost of schools and other government services.
The idea of the average adjustments is to get a general idea of the cost of living.