Not really. This is a naive interpretation of Darwinism. If anything, humans have become more genetically fit by mixing various formerly isolated populations together. Which is very much a consequence of global civilization.

By far the largest problem of any genetic pool (animals, plants, whatever) is not having enough genetic diversity in it. See: Cavendish bananas, the Tasmanian devil.