> People agree to trade Bitcoin for that amount of money and that's it.

Yes, however Bitcoin is still not used very much for traditional goods-and-services trade. Many people are buying Bitcoin as an investment in the ecosystem. They see the value in Bitcoin technology, and believe that it is promising enough to increase in value.