This is the thin end of the wedge fallacy. It's disproportionate to load of the possible extreme outcomes of a - true - idea on that idea. The idea is fine. Other things you list that are bad and not that idea are not fine.