If you know what you are doing you can get enough entropy that is true but there is still a lot of things that can happy in your life that will affect your memory but not be life ending. In those cases without a backup you'll lose your coins.