You should study the Constitution (really, it's interesting; I'm not trying to be snarky).

The answer here is: the government can restrict the time, place, and manner of free association in a content-neutral way (ie, it can't regulate based on whether the party is for Tea Partiers, Klansmen, or dubstep fans) so long as the restrictions are narrowly tailored to a valid government interest.