When someone says they don't do something for the money, what they mean is that some of the value of doing the work is that you enjoy the work. You might be able to get $15/hour doing something you hate, but doing something you love for $5/hour a few hours a week is worth the $10/hour difference. That doesn't inherently mean it's worth a $15/hour difference.

And even if it is, that doesn't mean you're happy about losing the $5/hour.