If the Constitution isn't clear enough on this matter, maybe this is something that we should pass into law. The government should never ever ever being able to ask for access to all the information from any service provider in third-party doctrine cases.
Using your analogy, the government wanted to "grep '^target_name$' phone_book.txt", so while software did see all 400k phone numbers, the government did not.
I happen to disagree with the court on this, but I think your analogy isn't useful as to understand why. Instead, there should be a balancing of cost vs. impact.
Levinson/Lavasoft stated that they would provide that pen register information for a development fee of some $2,000-$3,500. (Note: Verizon's price list says they charge about $700 for access to that data.)
The government refused to pay, saying that they were not aware of paying anyone else for pen trap data.
So the first question is, how much non-revenue generating work can a company be forced to do in order to respond to a pen register request? Obviously the answer has to be non-zero in order for the law to be meaningful, but it can't drive a company out of business.
The government points out that a cheap solution, which bypasses the internal architecture, is for the company to provide access to all of the data, and use filters to remove all non-relevant data.
The secondary question is, where does the boundary sit? Is it at the company/filter layer, where the company is force to release all records to the filter, or with the filter/human investigator layer, where the humans only see the relevant data?
Personally, I put it on the company/filter layer. The government and the court disagree with me. Their view is that you can trust the filter to do what it says it does. (When Levinson asked for oversight or audit of the filter, the judge denied the request.)
However, in the case of a "grep ... phonebook", where the filter program can be audited, and run with oversight from both sides, then I find the request to be more reasonable.
plus
> The government refused to pay, saying that they were not aware of paying anyone else for pen trap data
So the government is not aware of paying anyone, despite Verizon having a (semi)public price list?
Verizon quoted a $50 court processing fee, which almost certainly takes less than 1 hour to do. It charges a $50 activation fee, which can't reasonably take 1 hour, and $10/day pen tap fee, and I doubt a Verizon employee is spending more than 12 minutes per day per pen tap.
In other words, those documents show that Verizon is almost certainly charging more per unit time than Lavasoft would, and definitely not "several times" lower than Levinson.
That being said, thanks for the clarification and specific relevant facts from the PDF.
EDIT: Oh, I am a lawyer. I was just noting that in law school (and internet law especially) you have to be wary of judges/parties using analogies in their arguments b/c they are almost always imperfect in one way or another
I've found court judgements are often quite easy to understand, if you don't mind skipping a lot of citation references. For example, Computer Associates v. Altai helped me understand the abstraction-filtration-comparison test as applied to copyright of software.
(For example, it wasn't until 7th grade that I noticed that various books that I really liked were all written by the same author, so I should get more books by that author.)
The thing is, not many people believe a word the government says any-more. This is the government that doesn't "collect" any information on their citizens, doesn't "torture" anyone and so on. The government can make any promises it wants, with no intention of fulfilling them, then claim that the meanings of the words are not what you think they are, but the real meanings are secret, and why they're secret, is secret, and no one can ever know the true meaning lest we all be killed by terrorists.
And isn't it funny that the government can't seem to bring itself to find this pen-register information development fee, but there seems to be an infinite line of deficit spending for all kinds of corporate subsidies, bank bailouts, spying equipment and wedding killing drones.
The lawyers may argue and the courts may rule, but at the end of the day the core of this apple is rotten. And there's worms in it. Take a bite. It tastes like "freedom".
Absent clear mechanisms for watching the watchmen to make sure they not only respecting the 4th amendment rights of the other subscribers, but technically incapable of doing so (in order to mitigate rogue actors that want to impress their superiors via fishing expeditions), I can't see why we should have any reason to believe this information will not be abused. The government, especially the NSA and the FBI (by way of parallel construction), have proven to be outright liars. This alone should be enough for a judge to rule against the right of the government to make such broad requests. The government has be proven guilty of lying here. The burden is now on them to show that they are no longer guilty.
Those can't be illegal, although they can result in illegal actions being taken.