Well it's a base to work from. If it costs, on average X for Y things, and you know you are happy with about half of Y, then it'll still be cheaper to live in Cyanide Springs, Oklahoma, than in central London.
The idea of the average adjustments is to get a general idea of the cost of living.
If you insist on renting a nice 2bd aparment, you can do so for 2500 CHF in Zurich-city. If you move just slightly out of town, prices drop. I live on the southern end of town and my company is in the north. It takes me only 35 min to go through the whole city (Zurich is rather small).
In my opinion, cost-of-living averages give a misleading idea because people mentally give "cost of living" equal weight as to net-salary.
Although my life in Zurich costs more than my life in Munich, the ridiculous-high salaries and excellent working-conditions (I pay only 16% as taxes) make me feel that I win the lottery each and every month on pay-day. However, in case of sickness I would probably take a day off work and go to Germany (45 min trip) to go to the doctor there as doctors in Zurich also earn double as much.
My point being- I used to be able to save a tremendous amount of money; something like 65% of my after tax income, when I was single. Now that I'm married with two kids, I'm only able to save a much smaller 35%. I still live frugally, however, when you have young kids going to school, it's no longer possible to live like a monk. School is expensive, and kids are expensive to raise.
Cost of living is a very valid metric. At a minimum, it reflects the local property tax rates, which are basically the cost of schools and other government services.
What insurance do you buy? And do you live at home?
Moved away from crowded Berlin, no regrets.
BTW, I think I saw that appartment in Adliswil. Switzerland is so small ;)
Let's take me as an example: I manage to live modestly but well on around 1000 CHF (1050 USD) in Zurich while making around 6400 CHF (6700 USD) in net-salary. I am a junior software engineer hacking on Python in a SMB.
(Full disclosure: My company is hiring; feel free to reach out to me at iwang{at}fastmail.net. Also, my experiences working in Switzerland can be found here: "Eight reasons why I moved to Switzerland to work in IT" http://goo.gl/EIX4UX)