The swastika has been used as religious symbol for millennia before the Nazis adopted it. The Confederate flag was created specifically to represent a secessionist movement aiming to maintain the practice of slavery. The two situations are not nearly the same.