Requiring an average American is setting the bar a little too high. Ask almost any Jewish American and they're likely to have relatives who died in the Holocaust. How did the Nazis carry that out? They leveraged a large surveillance network and a central database built with census data. Was this personal harm from surveillance? I would argue yes.

Similarly, you could ask anyone who experienced life (or had a relative who did) in the Soviet Union or East Germany under the thumb of those overwhelming surveillance networks.

Finally, to prematurely head off an objection you might have: are these events (Nazi, Soviet, East Germany) outliers? Yes. Does that disqualify them? No. [0]

[0] http://slatestarcodex.com/2016/08/31/terrorists-vs-chairs-an...