Right, but especially in the legislature, a cohesive group can pretty much take over one of the two big parties (1994 Gingrich, 2010 Tea Party).

Parties also can implode and die (Whigs, Federalists, ...)