but the dots they had came from somewhere, right? And those were collected by some release of privacy.

The inverted argument is that, if a known criminal gets sent a letter through the mail, should the government be allowed to open it? Or is privacy that absolute?

The fact that both extremes (this and the postcard argument) seem a bit silly show that there's some sacrifice in privacy to be made.