Electrum lets you do this. You create a seed of about 10 words. Write them down and you can delete the wallet. I tested this. The issue in 10 years time might be that the original wallet source is lost so at least keep a copy of the exe.