That's what a dream is, though, isn't it? You decide that something matters to you. Sure, you can change your mind, but then the dream goes away, and it hurts to have your dreams crushed. I think that's really all he's saying.