If one has this genetic disposition, it's apparently possible that even moderate or modest exposure early in life is enough to cause the (extremely deadly and almost impossible to treat) disease at some point later in life. This point can come years or decades after exposure.
And if one isn't predisposed, then even heavy exposure to asbestos probably won't cause mesothelioma. It is of course still possible to get other really shitty lung problems from the mineral regardless of genetic factors, but meso itself seems to be very selective. This apparently is why it's relatively rare despite widespread asbestos use for decades before recent years in much of the world.
At least in terms of damage to the lungs, from what I gather (by reading wikipedia!) it's the degree of inflammatory response to the asbestos that is critical, not the presence of the asbestos itself. If your body thinks 'asbestos, oh shit!' and mounts a big response to attempt to wall off the particles etc. then you are in trouble.
Fun fact: asbestos is blowing around in the air pretty much everywhere at some level.
Since it is naturally occurring, it could be that some sort of natural selection has happened over time to cause people who live in naturally asbestos-rich areas to develop far greater immunity to its presence.
Gina Rinehart is the wealthiest person in Australia.
One of my dads friends had a business installing asbestos siding in the 1960's. He's in his 80's and seems fine. On the other hand his wife died of mesothelioma 20 years ago.
I visited it on school trips as a kid, and I'll never forget the sight of so many indigenous relics scrolling past the bus window. To think that it is all off-limits now, due to asbestos, is a real tragedy. Australia has so many of these kinds of deeply rich, deeply interesting sights that are tucked away behind a mining company's fence ..
So, its not like asbestos - in Australia - is only killing people. Its also masking a very significant degree of cultural heritage from the current generation that could benefit from understanding it more ..
I once worked with an environmental engineer who had a grandfather that worked at Wittenoom. He passed away due to mesothelioma, but her father who grew up there has not been affected, which is quite amazing given the circumstances. I have seen footage from Wittenoom of children playing in mounds of asbestos.
Today there are two general types of legacy asbestos products, friable and non-friable. Generally non-friable products such as asbestos-cement sheeting are considered safe to leave in place and are only dangerous when cut, broken or otherwise damaged. Friable products such as pipe lagging are very dangerous as they easily break down into fibers that can be inhaled.
It can be found in many old homes in odd places. I was removing some old putty around a window and a friend of mine who was an asbestos hygienist suggested that it could contain asbestos and took a sample for testing (all clear thankfully).
In another instance I worked on a demolition of a 1960's era multistory apartment complex. During construction of the concrete core walls the builder had used asbestos in the formwork, leaving some embedded in the wall at regular intervals. This meant that all of demolition waste was considered contaminated and was going to a special dump at a huge cost.
Finally, there was an infamous case in Canberra, Australia where a company called Mr Fluffy [1] installed loose friable asbestos as insulation in homes. A cleanup program in the 90's did not adequately fix the problem and so in 2014 the government finally purchased affected properties and demolished the houses.
Asbestos is bad stuff, but exposure causing mesothelioma seems to be a bit like Russian roulette. You might get it, you might not. But if you do, you will die.
[1] https://en.wikipedia.org/wiki/Mr_Fluffy