Unless you're a billionaire there are always going to be things you can't afford to do. For many if not most people, having enough passive income to live without having to work would be a dream come true.