"The difference here is that you're not a bacteria and can safely metabolize the drug itself."

All eurkaryotic cells have little trapped bacteria inside themm -- your mitochondria. The mutualistic cooperation between the mitochondria and the surrounding cell is an ancient and delecate dance.

And lo and behold, mitochondrial toxicity from antibiotics is a thing, and fluoroquinolones are suspected to cause it.