Seriously, I lose stuff occasionally but nothing as bulky and "expensive" as a HDD. I got a box where I put all computer hardware and I think I just "mentally track" items that cost more than say 50$ and that I walk around with, so I just check for them like I check for my keys or mobile when I leave the house.

Now a pen-drive maybe, but that wouldn't be the place to store my wallet anyway.