I used to do that a lot, and I finally realized that I actually didn't care about what was on the TV and just started leaving it off. Either a show is worth actually watching or it isn't IMO.

I guess it's a little bit of a different story if it's just the centerpiece of family time, though..