Jitter is what really kills it. I found out that my ISP (who own switches in the basement) limits bandwidth based on a rolling time window, so whenever someone in the house starts a download they can briefly saturate the entire link. Wish they'd know how to configure QoS on their very expensive network gear.