Beware the framing argument. If privacy advocates get stuck arguing about whether people "should" worry about terrorists, they are going to lose, because people do worry about terrorists. They've demonstrated it repeatedly in polls and elections.