Some of the surfer brands like Volcom, Reef, Lost etc sell wovens with little tiny logos on the pocket you can remove with a thread-ripper. I think that's not rare, though. Pretty sure you can even remove logos from some of the jeans. I guess I should also probably plug the lightweight pants from Club Monaco that I'm wearing right now because I don't see a logo on them. MUJI is also nice and unlabeled, still Japanese sensibility but a little more eclectic (their linen pillowcases are great).