You're right about the toll on the birds and other small animals, but not about the exploding population.

Key West has an informal program of spay/neuter of feral cats. They also inoculate them and notch their ears. It stabilizes the population.