I'm in the same boat as you on Twitter usage. But I suspect it's because being able to talk at anybody, including celebrities, is part of the appeal of the platform. The whitelisting mode you suggested makes it more like a one-way broadcast - you can see what people are saying but not join in.