Basically asbestos presents an opportunity for things to go wrong and for you to get cancer. There isn't a discrete threshold where you have been over-exposed and now have cancer - think really shit lottery tickets.

So over a population you'd generally expect to see the incidence correlate to the level of exposure, but not in a way that precludes unusual shit like this.