There‘s certainly a risk here but that is why we have laws. E.g. in Germany, showing fascist symbols is forbidden (unless it‘s an educational/historical context). It‘s up to the people and courts to ensure the law is not overstepping the boundaries of free expression, and it‘s up to the executive and judicial branch to ensure people don’t tend to prejudgement.