It's not that you're "wrong", but there are plenty of people who consider (or refer to themselves) as being alt-right, who are not white supremacists.