When I'm not living with others, this problem goes away. I start out with things in the wardrobe and drawers but as I get distracted by the things I actually want to do I gravitate towards a sort of inbox(clean)/outbox(dirty) 'floordrobe' system. It's surprisingly efficient.