That's a very good point. And prob the main reason why so many people hold those thoughts: the implications are very much unkown and the risk is very high. Generally, people don't like to take risks.

I don't think you're doing it wrong, maybe just a bit unlucky but I can see for sure that happening.