It seems obvious that one can increase the probability of this occurring by interacting with more people and creating more opportunities, from a purely statistical perspective, for something useful to emerge. The best way is to do so in a goal-oriented but not overly-specific or insincere way, as you say.
Why does this merit an article or a book?
Most popular nonfiction books written nowadays can be summed up in a few sentences. So this example isn't really that unusual.
Blogs > books
Hypotheses:
Humans have two modes of interaction with one another: social and economic. People tend to react much more favorably to each other during social mode, and this mode is only accessible during casual (serendipitous) encounters.
Salespeople are good at tricking others in to assuming the social interaction mode while the salesperson is assuming economic interaction mode.
The two modes theory explains why it's considered impolite to discuss how much money you make with friends.
The specific set of people you encounter may be largely a function of chance, but having the right mindset and drive to make the most of those relationships is not something you can't intentionally build.
I do the same thing with everyone I meet from security guards to random strangers. Everyone has something you can learn from. Everyone has a story it's just that most people never listen.
On the other hand, I've noticed that if you go out with a fixed agenda in mind; I want to meet angels, or something. There is a higher probability that it won't work. Most people have this ability to sense other people's agendas and that puts them off. No one wants to be used, but everyone likes an intelligent/decent conversation...
[edit: I forgot to add one of the most interesting ones. Recently, I met this woman in the park, who was there with her dogs. I started playing with them and I picked up a conversation with her. It turned out that she was an artist (mainly a dancer) and I spent half an hour with her talking about the beauty of things around us. We analyzed the shades of the trees how beautiful they were dancing in the wind, while the light played with their leaves. We talked about her dogs and her work.
It had to be one of the most interesting conversations I've had in years, and the best part is that she liked it. :) ]