It's not a fallacy in the case where something does happen to apply to both sides. As far as I am concerned, "both sides" in any debate are human beings, subject to human foibles.