Actually I do keep around a few old binaries, and I have more often seen something else: software that no longer compiles with a modern compiler, but the binary I built in 2000 still works.