This is exactly right. The problem is in some respects worse than stated. After the last bubble, it appears as though speculators did leave. However, every time the demand increases sharply for bitcoins, they return. After all, who could resist such a fantastic arbitrage opportunity?