No one said it'd be easy. But if you listen to customers with money and problems, at least you have a shot at being successful. When you approach people as the potential solution to their biggest problems, it's surprising how easily people will open up to you. And if one person doesn't open up, improve your pitch and go onto the next.
You make it sound much easier than it is. Getting out of the office: easy enough. Finding the right people who can tell you the right things at the right time: difficult. Very difficult.