There some asbestos products where the fibres can easily get into the air like lagging and others where they are bonded in side some product like a cement and it isn't a risk if you leave it alone. The risk for average people is home renovation as asbestos was used in a huge variety of building products and it isn't always obvious. Clearly you can do things to mitigate the risk.