Just getting an army from one planet to another would be ruinously expensive. Also, without some big leap in propulsion technology it's going to take something like a year for the invasion force to arrive. That gives the defender a whole lot of time to think about how he's going to respond and prepare accordingly.

Good point: The attacker loses the element of surprise and must maintain very long supply lines!