Choosing not to interact with people has opportunity costs, but we do it. For example, many of us choose not to interact with people with certain views (political or moral), even if we would gain a whole lot if we did.