Have you seen the interview with Bobby Lee recently? I think he made a great point. They asked him if he is worried that the bitcoin fluctuations undermine bitcoins' ability to function as a currency and discourages merchant adoption rate. He said that's what he initially thought as well, but since has come to the conclusion that bitcoin has to be seen foremost as a store of value and only through the "confidence" as you put it in a long term storage of value will the adoption as a currency eventually come all by itself. So he is not worried at all.

Found the link: http://www.youtube.com/watch?v=zz_yfB72S9c