Another version of "do both" I have seen and been guilty of is "let's just keep supporting X in case it will become relevant in the future".

Actually sitting now and deleting part of the code that should have died a long time ago.