The amount of dormant coins is not that large anymore. I read somewhere it's on the order of 30%. If they enter all at once the pool it would be a significant haircut for everyone else, but not the end. More significant risks are an 51% attack, a bug in the protocol, a bug in the implementation of a widely used client, or a major government making it illegal to trade them.