If the person in front of you isn't driving like such an jerk that you need to be looking around them to predict their moves or to find a passing opportunity it's not really a big deal.