If you have a mediocre employee that's ruining the productivity of less mediocre employees would you keep them around?

All the rest is noise. He simply wasn't worth keeping. Google keeps sexists, racists, and the like in it's executive and senior ranks. The difference is Google thinks they're worth it.