That's why isolating the researchers is not necessary. Also you underestimate the number of such labs and the amount and variety of work that such labs are doing. "Synthetic Pathogens" are not a thing. Synthetic viruses are hardly pathogenic at all.
If research is sufficiently dangerous to necessitate a BSL-3+ lab, then it should have to meet a correspondingly high bar for demonstrating its potential reward. It's not clear to me that gain of function research could ever make such a justification.
In an ideal world, we could do this research with remote controlled robots in an orbiting space capsule. If we can't do that yet, then we could at least do it in a desert. Otherwise, shouldn't we be asking the local population to approve each research proposal that could lead to a local outbreak of a dangerous virus?
Another comment in this thread suggested building these labs in a desert or some other extreme environment where scientists can be isolated for months at a time. This seems like an obviously necessary mitigation against the unknown risk of introducing synthetic pathogens that haven't been created in billions of years of evolution. And yet, the secretive groups funding and regulating this research instead choose to build their labs in urban centers. Why?