Select all, then deselect (ctrl-click) the one item you want to exclude. That's the exact same amount of work, just with the inversion step at the beginning instead of the end.