News for hackers. Stuff that matters.
Re:TSA to Commission Independent Study of X-Ray Body Scanners by untog on Tuesday December 18, 2012 @04:12PM (#4939617)
Well the entire purpose of the TSA is security. And how do you evaluate security? The number of successful attacks on airports?

Hopefully both the test set and TSA set would have a result of zero. And even if they didn't, you can't say for sure that it was because of TSA presence. So the test would be inconclusive, and we'd end up keeping them around "just in case". After all, we haven't had another attack like September 11th, so the TSA must be working, right?

Re:TSA to Commission Independent Study of X-Ray Body Scanners by jlgreco on Tuesday December 18, 2012 @04:50PM (#4939791)
> And how do you evaluate security?

It's easy: penetration testing.

With penetration testing you can determine the rate at which a baddy can expect to get by the TSA undetected. From what little of this testing has been done for the TSA, it seems the TSA performs abysmally.

Combine that with the number of false positives (thousands, if not dozens of thousands, a day), and the astronomically small baseline rate of terrorists in the population, and you get the chance that anyone the TSA catches is actually a terrorist. That (absurdly small) probability will tell you a lot about just how worthwhile the TSA is.

Re:TSA to Commission Independent Study of X-Ray Body Scanners by jessaustin on Tuesday December 18, 2012 @04:26PM (#4939682)
If you define security as "how many commercial airplanes have been flown into tall buildings", you're probably right. However, I'd also like to include such measures as "how many items have been stolen by TSA agents from luggage", "how many times does the TSA violate its stated policies", "how many bins of 'potential explosive materials' are stockpiled at security checkpoints", "how many times do red-team tests result in missed dangerous items", etc.

Really I think you could use any measure of security, even one picked out by TSA personnel, and the TSA as currently constituted would do worse than a private contractor reporting to the airlines. (Even if I'm wrong, wouldn't we want to know?) The important thing is that security must be balanced against the other things I mentioned: cost of the security program, indirect costs borne by airports and airlines, and passenger experience. From a societal perspective, we also have to weigh the costs associated with encouraging travelers to drive rather than fly.

Re:TSA to Commission Independent Study of X-Ray Body Scanners by untog on Tuesday December 18, 2012 @04:49PM (#4939789)
The important thing is that security must be balanced against the other things I mentioned

Which is exactly what wouldn't happen. The security theatre is persuasive to a great many people.

Re:TSA to Commission Independent Study of X-Ray Body Scanners by pdonis on Tuesday December 18, 2012 @04:38PM (#4939733)
how many items have been stolen by TSA agents from luggage

As far as I know, the amount of theft due to TSA is negligible; virtually all of it is due to airline employees.

Re:TSA to Commission Independent Study of X-Ray Body Scanners by jessaustin on Tuesday December 18, 2012 @04:57PM (#4939823)
I suggest googling for "tsa theft"; if they're firing hundreds of people a year every year it isn't a negligible problem. But even if more is stolen by airline employees than by TSA agents, that isn't a defense of the TSA. We couldn't fly without the airlines; we flew for decades without the TSA.
Re:TSA to Commission Independent Study of X-Ray Body Scanners by pdonis on Tuesday December 18, 2012 @05:08PM (#4939867)
if they're firing hundreds of people a year every year it isn't a negligible problem

From what I can see from a Google search, "hundreds" is the total number of TSA people who have ever been fired for theft, not the number per year.

Re:TSA to Commission Independent Study of X-Ray Body Scanners by jlgreco on Tuesday December 18, 2012 @05:36PM (#4940015)
Given the the low end of "hundreds" and the time the TSA has been in existence, that is still not negligible.

Particularly if they suck at catching/firing people as much as they do at any other sort of screening.

Re:TSA to Commission Independent Study of X-Ray Body Scanners by nodata on Tuesday December 18, 2012 @04:45PM (#4939766)
Cost benefit analysis. The cost is huge, the benefit is negligible.

Spend the money on something else: (hello healthcare!) High cost, huge benefit.

Re:TSA to Commission Independent Study of X-Ray Body Scanners by untog on Tuesday December 18, 2012 @04:48PM (#4939780)
The cost is huge, the benefit is negligible.

How are you evaluating benefit? We haven't had a major terror attack using planes since the TSA was brought into airports.

(yes, I'm playing devil's advocate here, but only because that's exactly what would happen)

Re:TSA to Commission Independent Study of X-Ray Body Scanners by jlgreco on Tuesday December 18, 2012 @05:46PM (#4940068)
Tiger repellent rocks, etc.

Seriously though, consider the false negative rate they have (by some accounts, as high as 70%), and the cost associated with actually being caught (they throw your knife into a bin, then wave you through onto the airplane). It just isn't plausible that the TSA is making terrorists to afraid to try.

Either the terrorists just don't care about hijacking the planes anymore (fairly plausible, planting IEDs is probably more fun), or something else is stopping them. Perhaps the thought of being dog-piled the second the passengers figure out what's up...